-- Logs begin at Sun 2022-09-04 00:10:48 UTC, end at Sun 2022-09-04 01:30:07 UTC. -- Sep 04 00:57:40.597664 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 04 00:57:40.606578 dv-cinder-master-3-smb devstack@n-api.service[106075]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 4 00:57:40 2022] *** Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: nodename: dv-cinder-master-3-smb Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: machine: x86_64 Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: clock source: unix Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: pcre jit disabled Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: detected number of CPU cores: 4 Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: current working directory: / Sep 04 00:57:40.609537 dv-cinder-master-3-smb devstack@n-api.service[106075]: detected binary path: /usr/bin/uwsgi-core Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: your processes number limit is 47680 Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: your memory page size is 4096 bytes Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: detected max file descriptor number: 2048 Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: lock engine: pthread robust mutexes Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: thunder lock: enabled Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 04 00:57:40.610166 dv-cinder-master-3-smb devstack@n-api.service[106075]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 04 00:57:40.648623 dv-cinder-master-3-smb devstack@n-api.service[106075]: Python main interpreter initialized at 0x5580ae6589c0 Sep 04 00:57:40.648623 dv-cinder-master-3-smb devstack@n-api.service[106075]: python threads support enabled Sep 04 00:57:40.648623 dv-cinder-master-3-smb devstack@n-api.service[106075]: your server socket listen backlog is limited to 100 connections Sep 04 00:57:40.648623 dv-cinder-master-3-smb devstack@n-api.service[106075]: your mercy for graceful operations on workers is 90 seconds Sep 04 00:57:40.648973 dv-cinder-master-3-smb devstack@n-api.service[106075]: mapped 403077 bytes (393 KB) for 2 cores Sep 04 00:57:40.649051 dv-cinder-master-3-smb devstack@n-api.service[106075]: *** Operational MODE: preforking *** Sep 04 00:57:40.649277 dv-cinder-master-3-smb devstack@n-api.service[106075]: *** uWSGI is running in multiple interpreter mode *** Sep 04 00:57:40.649277 dv-cinder-master-3-smb devstack@n-api.service[106075]: spawned uWSGI master process (pid: 106075) Sep 04 00:57:40.649471 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 04 00:57:40.650225 dv-cinder-master-3-smb devstack@n-api.service[106075]: spawned uWSGI worker 1 (pid: 106076, cores: 1) Sep 04 00:57:40.650386 dv-cinder-master-3-smb devstack@n-api.service[106075]: spawned uWSGI worker 2 (pid: 106077, cores: 1) Sep 04 00:57:40.650537 dv-cinder-master-3-smb devstack@n-api.service[106075]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 04 00:57:41.322986 dv-cinder-master-3-smb devstack@n-api.service[106076]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 00:57:41.330494 dv-cinder-master-3-smb devstack@n-api.service[106077]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 00:57:42.410237 dv-cinder-master-3-smb devstack@n-api.service[106076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:57:42.410237 dv-cinder-master-3-smb devstack@n-api.service[106076]: from cryptography.utils import int_from_bytes Sep 04 00:57:42.410865 dv-cinder-master-3-smb devstack@n-api.service[106076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:57:42.410865 dv-cinder-master-3-smb devstack@n-api.service[106076]: from cryptography.utils import int_from_bytes Sep 04 00:57:42.422896 dv-cinder-master-3-smb devstack@n-api.service[106077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:57:42.422896 dv-cinder-master-3-smb devstack@n-api.service[106077]: from cryptography.utils import int_from_bytes Sep 04 00:57:42.423395 dv-cinder-master-3-smb devstack@n-api.service[106077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 00:57:42.423395 dv-cinder-master-3-smb devstack@n-api.service[106077]: from cryptography.utils import int_from_bytes Sep 04 00:57:44.941623 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 00:57:44.942195 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 00:57:44.942388 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 00:57:44.942751 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 00:57:44.943002 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 00:57:44.943385 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.943706 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.944024 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.944340 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.944695 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.945007 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.945325 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.945642 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.945837 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 00:57:44.946193 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.946281 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 00:57:44.946365 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.946519 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.946621 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 00:57:44.946838 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.946962 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 00:57:44.947158 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.947242 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 00:57:44.947463 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.947592 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.947770 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.947918 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948084 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948241 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948375 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948586 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948720 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.948923 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949017 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949232 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949509 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949626 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949860 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.949970 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950189 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950299 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950448 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950569 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950763 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.950908 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.951086 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.951775 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.951994 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952128 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952314 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952486 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952645 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952847 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.952966 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953175 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953261 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953488 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953666 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953817 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.953982 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.954128 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.954293 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.954604 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.954694 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.954941 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955026 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955256 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955395 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955598 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955681 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955897 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.955991 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956215 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956357 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956543 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956635 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956883 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.956967 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957178 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957281 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957491 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957582 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957799 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.957892 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958098 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958183 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958403 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958496 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958710 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.958813 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959023 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959109 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959326 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959502 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959627 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959816 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.959907 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960128 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960222 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960450 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960548 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960795 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.960880 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961106 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961215 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961354 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961439 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961602 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961739 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.961918 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962058 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962235 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962376 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962540 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962678 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962845 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.962987 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963148 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963295 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963451 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963613 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963755 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.963916 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964056 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964221 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964359 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964492 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964688 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.964787 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965003 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965100 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965315 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965413 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965635 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965742 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.965938 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.966026 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.966205 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.966302 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.966524 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.966636 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.967423 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.967580 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.967802 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.967974 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.968188 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.968416 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.968602 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.968763 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.968914 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969083 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969235 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969399 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969557 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969713 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.969866 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970028 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970174 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970342 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970478 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970667 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970797 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.970989 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971128 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971315 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971430 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971626 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971715 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.971948 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972035 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972252 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972338 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972588 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972695 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972895 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.972990 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973201 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973296 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973505 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973612 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973805 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.973901 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974106 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974204 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974410 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974498 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.974800 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975018 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975105 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975324 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975420 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975635 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975723 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.975930 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976047 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976238 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976326 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976562 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976651 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976856 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.976959 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977161 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977256 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977479 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977573 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977784 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.977878 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978086 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978173 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978391 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978479 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978691 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.978784 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979002 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979091 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979303 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979389 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979607 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979708 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.979914 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980000 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980214 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980318 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980540 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980643 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980849 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.980936 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981150 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981243 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981456 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981553 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981764 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.981852 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982061 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982155 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982363 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982496 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982724 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.982877 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983098 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983348 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983455 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983670 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983759 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.983987 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984081 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984319 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984421 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984657 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984752 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.984960 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985055 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985261 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985359 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985560 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985655 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985887 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.985977 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986198 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986294 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986505 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986597 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986810 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.986891 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987112 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987208 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987420 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987506 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987732 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.987820 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.988053 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.988141 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.988363 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.988450 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.988699 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.988839 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.989007 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.989099 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.989313 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.989408 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.989619 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.989724 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.989928 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.990016 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.990233 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.990320 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.990542 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.990639 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.990844 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.990931 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.991163 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.991250 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.991472 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.991567 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.991782 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.991868 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.992093 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.992194 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.992400 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.992521 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.992747 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:57:44.992836 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993061 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993148 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993378 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993475 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993690 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.993779 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994006 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994093 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994334 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994423 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994656 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994753 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.994968 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995056 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995299 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995403 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995617 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995705 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.995939 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996026 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996252 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996339 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996596 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996700 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.996907 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997040 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997216 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997313 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997523 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997611 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997852 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.997939 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.998215 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.998457 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.998619 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.998825 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.998942 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999155 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999257 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999476 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999564 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999800 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:44.999894 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000133 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000223 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000473 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000562 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000795 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.000875 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001110 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001200 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001445 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001543 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001760 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.001847 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002085 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002174 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002401 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002489 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002711 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.002798 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003023 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003118 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003332 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003418 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003642 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003805 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.003952 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004040 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004258 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004354 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004588 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004693 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004897 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.004985 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005204 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005299 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005507 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005603 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005824 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.005912 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006135 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006236 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006448 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006552 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006758 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.006852 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007070 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007156 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007381 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007470 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007689 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007785 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.007999 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008087 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008302 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008392 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008637 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008741 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.008948 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009037 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009251 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009343 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009561 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009647 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009869 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.009963 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010173 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010270 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010479 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010566 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010784 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.010869 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011088 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011186 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011397 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011485 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011706 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.011812 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012015 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012103 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012326 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012415 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012659 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012767 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.012973 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.013061 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.013282 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.013368 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.013591 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.014175 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.014477 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.014632 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.014809 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.014997 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015133 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015322 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015455 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015638 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015772 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.015974 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016121 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016293 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016385 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016630 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016720 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.016949 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017046 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017254 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017357 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017558 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017645 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017867 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.017965 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018170 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018258 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018475 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018561 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018780 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.018877 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019086 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019173 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019391 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019528 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.019853 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020024 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020142 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020323 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020421 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020649 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020740 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.020953 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021039 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021292 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021378 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021596 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021691 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.021938 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022033 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022249 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022349 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022564 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022652 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022871 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.022956 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023182 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023275 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023491 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023576 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023798 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.023883 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024104 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024211 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024410 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024522 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024742 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.024838 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025051 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025193 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025361 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025445 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025679 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025765 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.025988 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.026082 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.026300 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.026450 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.026599 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.026748 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027165 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027256 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027487 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027626 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027801 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.027931 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028136 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028280 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028480 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028574 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028804 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.028904 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.029127 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.029216 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.029593 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.029679 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.029915 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.030150 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.030744 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031018 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031226 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031321 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031629 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031783 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.031948 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.032258 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.032345 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.032667 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.032947 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.033053 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.033292 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.033563 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.033652 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.033907 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034134 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034246 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034480 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034581 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034809 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.034904 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035141 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035306 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035452 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035540 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035764 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.035895 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036083 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036185 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036396 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036504 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036736 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.036826 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037049 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037165 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037352 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037493 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037659 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037827 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.037965 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038150 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038278 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038474 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038586 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038795 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.038896 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039116 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039205 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039434 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039522 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039751 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.039851 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040066 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040160 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040366 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040473 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040700 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.040790 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041015 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041101 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041322 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041422 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041643 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041741 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.041963 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042049 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042264 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042352 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042567 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042656 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042887 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.042974 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043192 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043281 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043493 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043595 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043795 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.043890 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044116 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044216 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044434 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044613 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044764 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.044852 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.045117 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.045221 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.045504 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.045674 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.045929 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046024 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046243 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046341 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046556 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046645 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046869 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.046964 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047177 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047274 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047500 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047588 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047814 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.047901 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048122 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048210 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048428 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048582 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048759 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.048846 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049076 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049166 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049386 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049474 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049699 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.049821 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050004 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050092 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050312 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050400 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050620 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050707 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.050922 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051012 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051230 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051317 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051546 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051634 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.051850 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052111 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052206 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052442 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052559 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052781 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.052870 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053099 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053188 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053404 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053499 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053724 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.053825 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054048 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054137 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054361 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054450 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054674 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054769 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.054980 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055081 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055290 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055380 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055594 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055692 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055898 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.055986 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056210 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056298 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056536 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056687 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056846 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.056936 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057150 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057239 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057460 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057548 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057761 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.057864 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058083 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058178 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058365 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058453 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058667 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058761 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.058976 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059070 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059275 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059362 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059583 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059716 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.059891 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.060148 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.060254 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.060504 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.061259 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.061415 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.061515 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.061722 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.061945 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062033 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062295 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062391 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062621 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062709 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.062959 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063055 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063283 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063368 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063601 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063684 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.063911 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064007 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064212 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064297 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064562 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064651 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064876 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.064977 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065180 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065267 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065482 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065574 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065791 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.065876 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066096 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066182 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066398 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066496 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066709 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.066860 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067000 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067136 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067302 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067450 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067610 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067754 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067910 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.067997 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068216 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068314 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068541 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068640 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068850 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.068941 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069153 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069259 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069455 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069542 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069757 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.069842 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070064 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070164 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070366 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070450 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070665 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070750 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.070972 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071059 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071271 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071357 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071585 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071670 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071886 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.071973 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072187 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072280 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072511 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072601 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072821 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.072908 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073127 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073213 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073428 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073523 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073751 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.073838 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074059 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074147 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074363 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074458 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074664 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074748 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.074967 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075060 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075267 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075363 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075569 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075662 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075874 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.075960 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.076221 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.076325 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.077201 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.077294 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.077521 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.077691 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.077840 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078039 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078187 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078337 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078481 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078616 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078764 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.078906 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079041 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079214 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079353 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079527 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079675 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079823 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.079962 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080141 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080231 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080428 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080562 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080775 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.080866 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081085 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081173 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081394 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081482 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081698 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.081788 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082001 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082098 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082312 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082400 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082620 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082707 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.082948 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083037 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083263 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083352 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083572 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083661 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083881 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.083969 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084186 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084273 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084511 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084602 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084822 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.084937 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085126 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085232 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085438 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085526 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085748 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.085854 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086052 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086138 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086351 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086444 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086654 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086753 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.086970 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087074 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087277 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087371 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087584 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087692 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087890 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.087984 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088195 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088290 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088518 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088631 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088827 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.088929 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089134 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089228 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089438 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089532 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089744 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.089838 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090052 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090167 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090358 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090461 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090663 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090754 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.090971 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091058 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091280 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091371 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091588 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091678 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.091955 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.092084 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.092259 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.092627 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.092814 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.092905 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093023 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093193 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093345 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093515 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093663 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093821 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.093981 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094123 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094314 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094427 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094598 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094730 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.094911 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095038 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095226 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095343 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095533 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095768 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.095856 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096078 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096168 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096386 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096503 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096716 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.096886 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097026 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097186 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097336 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097423 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097653 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097750 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.097967 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098079 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098272 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098368 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098607 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.098920 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099014 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099232 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099326 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099547 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099650 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099858 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.099957 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100161 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100254 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100499 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100595 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100803 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.100897 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101104 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101197 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101408 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101502 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.101824 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102020 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102107 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102324 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102419 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102643 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102731 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.102954 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103040 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103262 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103351 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103573 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103668 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.103880 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104049 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104193 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104335 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104517 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104671 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.104946 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105058 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105261 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105405 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105575 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105671 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105884 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.105996 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106197 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106294 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106516 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106683 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106823 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.106921 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.107138 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.107276 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.107472 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.107565 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.107801 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108109 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108216 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108436 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108553 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108781 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.108886 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109095 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109188 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109405 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109521 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109715 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.109810 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110029 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110132 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110356 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110451 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110664 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110759 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.110972 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111117 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111276 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111406 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111600 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111730 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.111908 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112050 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112214 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112351 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112551 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112695 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.112877 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113013 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113183 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113313 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113493 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113653 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113792 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.113966 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114094 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114279 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114416 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114605 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114830 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.114963 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115097 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115236 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115391 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115526 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115669 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115829 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.115972 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116133 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116262 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116490 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116582 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116800 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.116897 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117115 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117201 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117429 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117527 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117731 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.117825 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118031 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118116 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118335 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118430 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118670 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118755 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.118973 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119058 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119293 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119401 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119621 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119729 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.119949 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120044 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120259 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120347 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120619 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120786 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.120928 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121084 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121251 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121390 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121564 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121703 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.121873 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122019 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122170 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122306 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122484 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122628 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122783 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.122932 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.123604 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.123740 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124004 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124141 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124318 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124581 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124720 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.124898 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125037 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125211 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125358 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125530 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125663 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.125833 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126007 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126149 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126294 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126438 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126574 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126754 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.126901 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127062 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127208 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127353 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127487 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127655 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127793 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.127961 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128101 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128294 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128406 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128623 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128718 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.128932 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129026 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129249 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129340 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129571 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129662 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129885 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.129979 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130201 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130287 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130516 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130602 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130832 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.130923 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131146 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131236 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131471 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131566 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131784 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.131877 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132091 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132178 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132408 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132537 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132747 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.132840 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133058 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133144 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133367 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133576 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133664 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133905 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.133991 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134221 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134309 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134535 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134623 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134847 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.134933 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135151 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135243 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135456 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135544 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135761 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.135858 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136068 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136161 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136379 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136491 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136729 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.136832 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137041 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137137 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137354 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137442 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137661 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137765 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.137966 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.138053 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.138308 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.138392 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.138614 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.138759 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.139643 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.139731 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140046 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140154 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140328 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140496 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140672 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140816 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.140983 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141142 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141301 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141465 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141635 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141786 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.141942 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142107 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142258 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142428 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142571 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142729 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.142887 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143048 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143200 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143367 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143511 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143686 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.143822 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144009 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144135 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144447 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144552 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144792 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.144892 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145126 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145285 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145446 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145533 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145761 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.145847 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146074 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146170 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146390 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146483 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146702 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.146904 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147005 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147219 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147307 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147553 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147651 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147888 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.147987 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148215 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148302 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148555 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148655 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148879 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.148974 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149206 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149300 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149513 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149608 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149819 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.149913 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150130 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150224 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150440 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150526 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150744 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.150832 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151067 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151162 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151376 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151462 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151680 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.151767 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.152267 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.152352 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.152600 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.152699 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.152914 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153134 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153221 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153483 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153570 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153800 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.153895 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.154124 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.154211 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.154536 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.154743 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.154921 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155124 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155210 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155528 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155614 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155845 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.155942 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156155 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156242 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156493 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156595 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156811 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.156899 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157119 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157205 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157426 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157642 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157742 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.157962 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158058 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158297 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158384 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158627 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158765 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.158931 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159015 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159256 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159342 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159563 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159662 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159871 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.159956 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160177 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160263 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160507 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160697 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160817 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.160904 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161121 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161207 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161428 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161518 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161732 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.161826 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162042 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162129 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162346 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162434 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162655 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162745 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.162958 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163044 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163266 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163500 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163618 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163852 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.163938 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164173 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164261 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164526 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164617 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164852 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.164936 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165156 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165251 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165471 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165564 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165778 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.165864 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166095 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166189 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166404 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166499 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.166798 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167026 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167112 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167335 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167422 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167644 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167888 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.167977 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168230 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168316 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168581 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168670 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168898 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.168999 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169204 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169290 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169535 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169634 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169845 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.169933 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.170290 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.170376 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.170709 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.170848 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171026 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171205 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171345 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171490 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171658 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171803 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.171971 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172116 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172285 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172428 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172622 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172779 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.172934 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173092 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173246 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173406 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173557 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173715 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.173866 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174032 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174175 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174388 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174486 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174703 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.174796 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175011 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175097 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175338 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175499 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175646 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175733 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.175954 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176047 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176276 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176373 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176614 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176704 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.176943 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177040 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177251 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177346 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177564 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177649 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177876 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.177962 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.178187 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.178289 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.178500 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.178744 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.178831 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.179089 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.179191 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.179415 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.179511 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.179758 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180072 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180166 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180388 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180494 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180736 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.180824 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181048 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181145 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181362 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181455 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181682 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.181773 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182000 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182095 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182310 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182402 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182630 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182722 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.182939 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183038 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183251 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183337 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183564 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183658 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183877 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.183964 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184189 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184276 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184528 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184619 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184836 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.184930 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.185143 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.185229 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.185452 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186066 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186298 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186441 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186611 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186868 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.186962 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187207 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187300 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187516 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187609 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187820 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.187907 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188130 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188217 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188433 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188583 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188759 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.188864 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189068 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189165 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189368 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189454 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189671 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189757 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.189974 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190069 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190276 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190364 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190579 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190672 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190882 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.190983 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.191188 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.191489 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.191573 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.191840 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.191938 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192096 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192190 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192400 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192540 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192728 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.192817 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193061 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193148 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193393 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193491 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193708 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.193794 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194028 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194115 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194339 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194442 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194658 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194745 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.194967 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195054 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195288 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195384 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195610 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195696 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.195925 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196010 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196233 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196373 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196564 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196659 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196880 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.196977 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197187 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197281 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197498 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197586 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197805 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.197890 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198112 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198201 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198420 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198514 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198724 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.198809 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199031 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199164 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199338 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199438 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199647 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199733 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.199958 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200052 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200266 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200352 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200603 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200704 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.200914 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.201001 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.201793 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.201927 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202170 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202346 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202481 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202663 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202795 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.202979 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203109 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203290 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203421 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203603 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203738 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.203911 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204049 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204222 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204359 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204556 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204704 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.204895 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205023 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205232 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205359 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205553 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205688 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.205882 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206040 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206197 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206314 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206524 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206673 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206839 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.206973 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207164 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207284 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207489 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207628 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207815 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.207955 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208129 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208276 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208499 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208619 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208801 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.208928 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.209116 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.209202 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 00:57:45.209431 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.209745 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.210059 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.210371 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.210701 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.211030 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.211340 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.211668 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.211987 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.212309 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.212666 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.212983 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.213316 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.213629 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.213942 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.214256 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.214571 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.214884 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.215202 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.215515 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.215827 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.216145 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.216474 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.216874 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.217443 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.217866 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.218204 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.218557 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.218896 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.219218 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.219571 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.219905 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.220229 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.220571 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.220886 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:57:45.221132 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 00:57:45.362117 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO dbcounter [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Registered counter for database nova_api Sep 04 00:57:45.380603 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO dbcounter [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Registered counter for database nova_api Sep 04 00:57:45.383332 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.390605 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.402698 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.409642 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.447377 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.context [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=106076) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 00:57:45.451285 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 00:57:45.451765 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 00:57:45.453349 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 00:57:45.454071 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 00:57:45.454523 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 00:57:45.456510 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 00:57:45.458467 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO dbcounter [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Registered counter for database nova_cell0 Sep 04 00:57:45.462429 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO dbcounter [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Registered counter for database nova_cell1 Sep 04 00:57:45.468300 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.context [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=106077) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 00:57:45.470130 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.471888 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.474033 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 00:57:45.474527 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 00:57:45.476127 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 00:57:45.476887 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 00:57:45.477343 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 00:57:45.477468 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.479344 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 00:57:45.480284 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.481400 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO dbcounter [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Registered counter for database nova_cell0 Sep 04 00:57:45.486397 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO dbcounter [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Registered counter for database nova_cell1 Sep 04 00:57:45.493460 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.495161 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.502997 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.503338 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.629514 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO dbcounter [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Registered counter for database nova_cell0 Sep 04 00:57:45.638209 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.642865 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:45.653829 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO dbcounter [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Registered counter for database nova_cell0 Sep 04 00:57:45.661184 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 00:57:45.666042 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 00:57:46.059846 dv-cinder-master-3-smb devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 00:57:46.067314 dv-cinder-master-3-smb devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 00:57:46.071351 dv-cinder-master-3-smb devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 00:57:46.078714 dv-cinder-master-3-smb devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 00:57:46.414727 dv-cinder-master-3-smb devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 00:57:46.420782 dv-cinder-master-3-smb devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 00:57:46.422515 dv-cinder-master-3-smb devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 00:57:46.426149 dv-cinder-master-3-smb devstack@n-api.service[106076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580ae6589c0 pid: 106076 (default app) Sep 04 00:57:46.428227 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:57:46.428414 dv-cinder-master-3-smb devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-3b275dfc-d16c-4cc7-b59d-44d7a76bb427 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 00:57:46.429460 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Sep 04 00:57:46.429881 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Sun Sep 4 00:57:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:57:46.433683 dv-cinder-master-3-smb devstack@n-api.service[106077]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580ae6589c0 pid: 106077 (default app) Sep 04 00:59:06.746002 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:06.747011 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 04 00:59:06.747416 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:06.759692 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:06.761056 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell0:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:06.762000 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell1:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:06.764028 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:07.647311 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-fd2fd64d-2183-4bd1-9678-d5801367e298 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:07.679372 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-fd2fd64d-2183-4bd1-9678-d5801367e298 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925006 Sep 04 00:59:07.680253 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Sun Sep 4 00:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:10.061458 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:10.062640 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-acd67c53-4f9a-4f60-8971-9dce39d0a336 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 04 00:59:10.062640 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:10.495165 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-1c2dede9-3c73-4173-b8b6-9ff12aacf05b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:10.599376 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-1c2dede9-3c73-4173-b8b6-9ff12aacf05b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.529866 Sep 04 00:59:10.600238 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:10.615470 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:10.616620 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell1:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:10.618566 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell0:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:10.619868 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:10.834183 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-81a49540-e020-46aa-963d-0feb62af6095 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:10.958455 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-81a49540-e020-46aa-963d-0feb62af6095 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348669 Sep 04 00:59:10.959265 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Sun Sep 4 00:59:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 00:59:13.338529 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-1c2dede9-3c73-4173-b8b6-9ff12aacf05b admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:13.339561 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-1c2dede9-3c73-4173-b8b6-9ff12aacf05b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 04 00:59:13.339965 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:14.004116 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-74ea1b5a-51f3-4f8a-b657-277323ccca44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:14.117499 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-74ea1b5a-51f3-4f8a-b657-277323ccca44 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.770285 Sep 04 00:59:14.118292 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:14.130679 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-9b79c122-3501-472b-8af8-c8f4d93ed31d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:14.212133 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-9b79c122-3501-472b-8af8-c8f4d93ed31d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085087 Sep 04 00:59:14.212762 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Sun Sep 4 00:59:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:16.569734 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-74ea1b5a-51f3-4f8a-b657-277323ccca44 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:16.570826 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-74ea1b5a-51f3-4f8a-b657-277323ccca44 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 04 00:59:16.571231 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:16.960872 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-ce375eaf-efe8-442d-a562-b3991cbf7a7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "id": "d2", "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:17.029055 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-ce375eaf-efe8-442d-a562-b3991cbf7a7f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450659 Sep 04 00:59:17.030085 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:17.042376 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c5327e9c-7d1a-4eca-ab02-65643e46a8e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:17.119158 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-c5327e9c-7d1a-4eca-ab02-65643e46a8e9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080457 Sep 04 00:59:17.119965 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Sun Sep 4 00:59:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 00:59:19.490046 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-ce375eaf-efe8-442d-a562-b3991cbf7a7f admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:19.491005 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-ce375eaf-efe8-442d-a562-b3991cbf7a7f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 04 00:59:19.491561 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:19.926724 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-89ad77f8-d250-4b49-beef-8b7d574f990e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:19.979658 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-89ad77f8-d250-4b49-beef-8b7d574f990e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481836 Sep 04 00:59:19.980690 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:19.993250 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-244daea4-43b8-43c2-b820-77b46fe3e495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:20.085526 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-244daea4-43b8-43c2-b820-77b46fe3e495 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096102 Sep 04 00:59:20.086379 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Sun Sep 4 00:59:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:22.481088 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-89ad77f8-d250-4b49-beef-8b7d574f990e admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:22.482184 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-89ad77f8-d250-4b49-beef-8b7d574f990e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 04 00:59:22.482600 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:22.909696 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:22.985646 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496644 Sep 04 00:59:22.986590 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:22.998171 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-0615b2bb-0241-4fa2-a942-004f47b5f346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:23.063094 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-0615b2bb-0241-4fa2-a942-004f47b5f346 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068478 Sep 04 00:59:23.063615 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Sun Sep 4 00:59:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:25.707030 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:25.708110 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 04 00:59:25.708555 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:26.161413 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-175f7650-4fa6-4db0-bccf-e2b77abb6516 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:26.193656 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-175f7650-4fa6-4db0-bccf-e2b77abb6516 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477731 Sep 04 00:59:26.194488 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Sun Sep 4 00:59:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 00:59:28.655785 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:28.656950 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8e316295-7c57-4136-ba24-9f28ece569c5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Sep 04 00:59:28.657366 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:29.092062 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f908dc25-dce0-4468-a994-5a10a96061fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:29.202585 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f908dc25-dce0-4468-a994-5a10a96061fa admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.538599 Sep 04 00:59:29.203178 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:29.215389 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-b95702c1-009c-4dc0-a476-3d31afa5b5ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:29.280536 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-b95702c1-009c-4dc0-a476-3d31afa5b5ce admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068683 Sep 04 00:59:29.281042 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Sun Sep 4 00:59:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:31.597969 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f908dc25-dce0-4468-a994-5a10a96061fa admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:31.599082 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f908dc25-dce0-4468-a994-5a10a96061fa admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 04 00:59:31.599486 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:31.974171 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-7eedaa2e-6158-4f89-98d3-5c9c1e20ff23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:32.048196 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-7eedaa2e-6158-4f89-98d3-5c9c1e20ff23 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442454 Sep 04 00:59:32.048783 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:32.061494 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-846ccb9c-7adb-46e2-8ade-585df4be57ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:32.130635 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-846ccb9c-7adb-46e2-8ade-585df4be57ee admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073399 Sep 04 00:59:32.131163 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Sun Sep 4 00:59:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 00:59:34.549066 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-7eedaa2e-6158-4f89-98d3-5c9c1e20ff23 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:34.550071 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-7eedaa2e-6158-4f89-98d3-5c9c1e20ff23 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 04 00:59:34.550691 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:34.987561 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-14eacd97-7574-4d95-a814-7441d2e78c9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40, "name": "m1.medium", "ram": 4096}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:35.082398 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-14eacd97-7574-4d95-a814-7441d2e78c9e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525709 Sep 04 00:59:35.083342 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:35.095873 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-20ea9313-e4b4-4f07-a91f-e5b7baec7707 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:35.173405 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-20ea9313-e4b4-4f07-a91f-e5b7baec7707 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081241 Sep 04 00:59:35.174361 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Sun Sep 4 00:59:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:37.573444 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-14eacd97-7574-4d95-a814-7441d2e78c9e admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:37.575209 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-14eacd97-7574-4d95-a814-7441d2e78c9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Sep 04 00:59:37.575856 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 00:59:38.047473 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a9b40f71-2c7a-402e-8c91-53e5909752f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "id": "4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:38.054956 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:38.122094 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-a9b40f71-2c7a-402e-8c91-53e5909752f9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539617 Sep 04 00:59:38.124508 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:38.135231 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-04a4f76d-ea35-49c9-b1ad-346edfaf8215 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:38.196380 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-04a4f76d-ea35-49c9-b1ad-346edfaf8215 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064602 Sep 04 00:59:38.197716 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Sun Sep 4 00:59:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 00:59:40.754936 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a9b40f71-2c7a-402e-8c91-53e5909752f9 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:40.756209 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-a9b40f71-2c7a-402e-8c91-53e5909752f9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 04 00:59:40.756353 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 00:59:41.238582 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:41.245125 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 00:59:41.321560 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.558640 Sep 04 00:59:41.322616 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Sun Sep 4 00:59:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 00:59:41.335276 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-162110a3-53b1-41b4-8640-8b3ab88f694d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 00:59:41.428372 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-162110a3-53b1-41b4-8640-8b3ab88f694d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096662 Sep 04 00:59:41.428934 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Sun Sep 4 00:59:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 00:59:59.943413 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 00:59:59.944479 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 04 00:59:59.944881 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 00:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:00.329356 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-73caff09-3ee8-4988-8153-8803cf7f2bc0 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:00.347643 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-73caff09-3ee8-4988-8153-8803cf7f2bc0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396458 Sep 04 01:00:00.348171 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Sun Sep 4 00:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:00:01.411213 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:01.412219 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-88143933-e20c-4cf5-b2fa-752610364c72 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 04 01:00:01.412642 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:01.939849 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-82a5b16d-c5c8-4b8e-888e-3c1c2e06f1a8 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:01.945482 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-82a5b16d-c5c8-4b8e-888e-3c1c2e06f1a8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-82a5b16d-c5c8-4b8e-888e-3c1c2e06f1a8 admin admin] Request method failure captured: Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept: application/json Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Connection: keep-alive Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Content-Length: 0 Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Host: 10.222.0.27 Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjE_iRo-zMkuGEayVBdHg8Vn_g9i-VShH93jnl6ITeMSud9ddmy4fJEyp3H4afDHinX5NhdR_vWguLZNS4hVnIVkbMjhcuLWoQTkxv8viRQ2T9etjiGWdPNVJK9FtZPYhcNnzKqw5Wm2lfJOMxE5OTzAaYL-R5qS_rhqlwDAcF01j0n6w Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Id: None Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Name: None Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Name: admin Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Role: admin,reader,member Sep 04 01:00:01.948757 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Roles: admin,reader,member Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant: admin Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User: admin Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Name: admin Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: method: > Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: exception: Flavor 42 could not be found. Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: action_args: {'id': '42'} Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:01.950507 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:01.951600 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:01.953129 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-82a5b16d-c5c8-4b8e-888e-3c1c2e06f1a8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:01.954404 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-82a5b16d-c5c8-4b8e-888e-3c1c2e06f1a8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399679 Sep 04 01:00:01.954404 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Sep 4 01:00:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:01.960034 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-e660a0e1-bb34-4099-a588-2a52f14fdd1a admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:01.982941 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-e660a0e1-bb34-4099-a588-2a52f14fdd1a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026531 Sep 04 01:00:01.983491 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:00:01.993329 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-9e94914e-ad4a-4e4a-801f-3fc222016fdd admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:02.016563 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-9e94914e-ad4a-4e4a-801f-3fc222016fdd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026844 Sep 04 01:00:02.017112 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:00:02.027055 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-1eaa7291-0792-4bad-b5ef-a11106edfc50 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:02.033130 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-1eaa7291-0792-4bad-b5ef-a11106edfc50 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-1eaa7291-0792-4bad-b5ef-a11106edfc50 admin admin] Request method failure captured: Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept: application/json Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Connection: keep-alive Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Content-Length: 0 Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Host: 10.222.0.27 Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjE_iRo-zMkuGEayVBdHg8Vn_g9i-VShH93jnl6ITeMSud9ddmy4fJEyp3H4afDHinX5NhdR_vWguLZNS4hVnIVkbMjhcuLWoQTkxv8viRQ2T9etjiGWdPNVJK9FtZPYhcNnzKqw5Wm2lfJOMxE5OTzAaYL-R5qS_rhqlwDAcF01j0n6w Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Id: None Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Name: None Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Name: admin Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Role: admin,reader,member Sep 04 01:00:02.036441 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Roles: admin,reader,member Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant: admin Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User: admin Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Name: admin Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: method: > Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: exception: Flavor 42 could not be found. Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: action_args: {'id': '42'} Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:02.045003 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:02.045899 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:02.046943 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-1eaa7291-0792-4bad-b5ef-a11106edfc50 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:02.047963 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-1eaa7291-0792-4bad-b5ef-a11106edfc50 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014980 Sep 04 01:00:02.047963 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Sep 4 01:00:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:03.000661 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-9e94914e-ad4a-4e4a-801f-3fc222016fdd admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:03.001692 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-9e94914e-ad4a-4e4a-801f-3fc222016fdd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 04 01:00:03.002087 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:03.525188 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3dd5f287-8908-4e83-8949-03dc9d40c8cd admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:03.530449 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-3dd5f287-8908-4e83-8949-03dc9d40c8cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3dd5f287-8908-4e83-8949-03dc9d40c8cd admin admin] Request method failure captured: Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept: application/json Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Connection: keep-alive Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Content-Length: 0 Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Host: 10.222.0.27 Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjE_iSq5e-ma9vVVaWnLUVnBRFJo6aEDBf52F7KGsDB1-IhBdEdHSkJhWRrfpXgoCdFhle_uQ8MNo-yXN96gXVXCwBacgU4dVAqgZ95vQDG8VMfAq2cvQbNkrCw6avN7ChjJu5CIDK7ryXKc2lPKSs0LvioHxL3_T98AR9l0uy0z290Mg Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Id: None Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Name: None Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Name: admin Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Role: admin,reader,member Sep 04 01:00:03.531938 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Roles: admin,reader,member Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant: admin Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User: admin Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Name: admin Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: method: > Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: exception: Flavor 84 could not be found. Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: action_args: {'id': '84'} Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:03.533451 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:03.534242 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.535331 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3dd5f287-8908-4e83-8949-03dc9d40c8cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:03.536342 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-3dd5f287-8908-4e83-8949-03dc9d40c8cd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392583 Sep 04 01:00:03.536342 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Sep 4 01:00:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:03.543483 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a575ba2b-35e3-4ed8-810c-bbfd684cc3bc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:03.559334 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-a575ba2b-35e3-4ed8-810c-bbfd684cc3bc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019409 Sep 04 01:00:03.559858 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:00:03.569155 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-03be8975-5c2b-43bf-9ea1-e303c2aa6f37 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:03.584027 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-03be8975-5c2b-43bf-9ea1-e303c2aa6f37 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018350 Sep 04 01:00:03.584606 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:00:03.593913 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-e89af9fc-98f0-4a77-9fb4-0aab09b04fb2 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:03.599175 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-e89af9fc-98f0-4a77-9fb4-0aab09b04fb2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-e89af9fc-98f0-4a77-9fb4-0aab09b04fb2 admin admin] Request method failure captured: Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept: application/json Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Connection: keep-alive Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Content-Length: 0 Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Host: 10.222.0.27 Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjE_iSq5e-ma9vVVaWnLUVnBRFJo6aEDBf52F7KGsDB1-IhBdEdHSkJhWRrfpXgoCdFhle_uQ8MNo-yXN96gXVXCwBacgU4dVAqgZ95vQDG8VMfAq2cvQbNkrCw6avN7ChjJu5CIDK7ryXKc2lPKSs0LvioHxL3_T98AR9l0uy0z290Mg Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Id: None Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Name: None Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Name: admin Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Role: admin,reader,member Sep 04 01:00:03.600714 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Roles: admin,reader,member Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant: admin Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User: admin Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Name: admin Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: method: > Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: exception: Flavor 84 could not be found. Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: action_args: {'id': '84'} Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:03.602243 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:03.603444 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:03.604832 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-e89af9fc-98f0-4a77-9fb4-0aab09b04fb2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:03.606467 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-e89af9fc-98f0-4a77-9fb4-0aab09b04fb2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011704 Sep 04 01:00:03.606467 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Sep 4 01:00:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:04.559721 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-03be8975-5c2b-43bf-9ea1-e303c2aa6f37 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:04.560743 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-03be8975-5c2b-43bf-9ea1-e303c2aa6f37 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 04 01:00:04.561133 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:00:05.082690 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-256095c4-192f-4cb5-b280-31c749b2ea5f admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:05.088324 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-256095c4-192f-4cb5-b280-31c749b2ea5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-256095c4-192f-4cb5-b280-31c749b2ea5f admin admin] Request method failure captured: Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept: application/json Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Connection: keep-alive Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Content-Length: 0 Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Host: 10.222.0.27 Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjE_iUzWpU1BMkrlSariKI1JO4j8ObA_tGrKkWrj4BZ9veDQ3xkvdnQvxnBLZbyec27gv731Lw2UzYLfIYcUqVV_nQvzvOLGOEb8uBs2S6glgvcL2YfZclx-gmNBD1sTdhgPOLmvf2_GgFhHzLAbXHkshK68O8G3ibaq6OzI6xKvVOJ0U Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Id: None Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Domain-Name: None Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Project-Name: admin Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Role: admin,reader,member Sep 04 01:00:05.091069 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Roles: admin,reader,member Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant: admin Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User: admin Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: X-User-Name: admin Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: method: > Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: exception: Flavor 451 could not be found. Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: action_args: {'id': '451'} Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:05.092634 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:05.093488 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.094793 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-256095c4-192f-4cb5-b280-31c749b2ea5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:05.095999 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-256095c4-192f-4cb5-b280-31c749b2ea5f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395564 Sep 04 01:00:05.095999 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:00:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 01:00:05.102070 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-5ca2c73d-da85-4449-9916-300af65dc01a admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:05.117027 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-5ca2c73d-da85-4449-9916-300af65dc01a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018524 Sep 04 01:00:05.117558 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:00:05.126985 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:05.142652 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019174 Sep 04 01:00:05.143181 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Sep 4 01:00:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:00:05.153196 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c266b260-7a31-4e80-a3a2-74614dff0aee admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:05.158446 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-c266b260-7a31-4e80-a3a2-74614dff0aee admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c266b260-7a31-4e80-a3a2-74614dff0aee admin admin] Request method failure captured: Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept: application/json Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Connection: keep-alive Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Content-Length: 0 Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Host: 10.222.0.27 Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjE_iUzWpU1BMkrlSariKI1JO4j8ObA_tGrKkWrj4BZ9veDQ3xkvdnQvxnBLZbyec27gv731Lw2UzYLfIYcUqVV_nQvzvOLGOEb8uBs2S6glgvcL2YfZclx-gmNBD1sTdhgPOLmvf2_GgFhHzLAbXHkshK68O8G3ibaq6OzI6xKvVOJ0U Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Id: None Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Domain-Name: None Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Project-Name: admin Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Role: admin,reader,member Sep 04 01:00:05.159940 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Roles: admin,reader,member Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a1d8c40dd6c04e8e8fe6b0c2b34723cd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a1d8c40dd6c04e8e8fe6b0c2b34723cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant: admin Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Id: a1d8c40dd6c04e8e8fe6b0c2b34723cd Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User: admin Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Id: 644f0b1b120742d2aca15aeeaa76abcc Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: X-User-Name: admin Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: method: > Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: exception: Flavor 451 could not be found. Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: action_args: {'id': '451'} Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:00:05.161480 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:05.163876 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 04 01:00:05.165222 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c266b260-7a31-4e80-a3a2-74614dff0aee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:00:05.166558 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-c266b260-7a31-4e80-a3a2-74614dff0aee admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012676 Sep 04 01:00:05.166558 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:00:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 04 01:00:06.129386 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:06.130397 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 04 01:00:06.130792 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:06.648697 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3171e72d-d027-4a5c-9153-ad6dac1fbbeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:00:06.725707 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-3171e72d-d027-4a5c-9153-ad6dac1fbbeb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.454645 Sep 04 01:00:06.726250 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Sep 4 01:00:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:00:07.687419 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:07.688423 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 04 01:00:07.688871 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:08.209275 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-ddbda3d6-a844-44a9-bb12-4a9aef233aa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:00:08.269973 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-ddbda3d6-a844-44a9-bb12-4a9aef233aa5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.445884 Sep 04 01:00:08.270515 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Sep 4 01:00:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:00:09.236204 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:09.237418 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 04 01:00:09.237815 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:09.753311 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-31f25be6-4c43-4dad-b5a9-d5043ecd449e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:00:09.817180 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-31f25be6-4c43-4dad-b5a9-d5043ecd449e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.442693 Sep 04 01:00:09.817743 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Sep 4 01:00:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:00:10.780928 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:10.781954 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 04 01:00:10.782351 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:11.304985 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3d37a65a-4f75-4d31-ad6b-fc5840ccbcae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:00:11.371750 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-3d37a65a-4f75-4d31-ad6b-fc5840ccbcae admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.451583 Sep 04 01:00:11.372322 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Sep 4 01:00:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 01:00:12.345381 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:12.346411 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 04 01:00:12.346812 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:00:12.870034 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-ff5e8306-824e-4bec-97cb-24bfcde08bb3 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:00:12.891916 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-ff5e8306-824e-4bec-97cb-24bfcde08bb3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403324 Sep 04 01:00:12.892470 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Sun Sep 4 01:00:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:01:06.547670 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:06.548702 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-8890d4c7-dbcd-4930-a563-6cccd7691937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 04 01:01:06.549102 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Sun Sep 4 01:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:01:06.560181 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:06.941541 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-77e53959-d062-4e46-9689-19e7046ba148 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:06.963345 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-77e53959-d062-4e46-9689-19e7046ba148 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408288 Sep 04 01:01:06.963890 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Sun Sep 4 01:01:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:01:06.985567 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:01:06.989334 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-01c3357f-7a09-4b61-9d62-76d3bd0b483e admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:06.997083 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-01c3357f-7a09-4b61-9d62-76d3bd0b483e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013107 Sep 04 01:01:06.997591 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Sun Sep 4 01:01:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:01:07.009188 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f22db3c8-085b-4598-9fb0-99a11a05c407 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:07.017120 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f22db3c8-085b-4598-9fb0-99a11a05c407 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011519 Sep 04 01:01:07.017635 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Sun Sep 4 01:01:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:01:07.030647 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:07.038317 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011520 Sep 04 01:01:07.038838 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Sun Sep 4 01:01:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:01:07.050632 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-4cce2cd8-42d3-44f3-b14d-7cbe27ba70f8 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:01:07.058190 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-4cce2cd8-42d3-44f3-b14d-7cbe27ba70f8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011060 Sep 04 01:01:07.058700 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Sun Sep 4 01:01:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:04:20.738347 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:20.740127 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Sep 04 01:04:20.740560 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:04:20.885026 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=6 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:21.046620 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:21.050189 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:21.050691 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:21.051121 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:21.051912 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:21.052359 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:21.052798 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:21.086808 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f44c3b21-9360-4a12-97c8-f1db51d1cf7a admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.203306 Sep 04 01:04:21.087375 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:04:20 2022] GET /compute/v2.1/os-services => generated 785 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:04:21.918791 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:21.919827 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 04 01:04:21.920232 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:04:22.111886 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:22.115431 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:22.115904 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:22.116330 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:22.117068 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:22.117515 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:22.117932 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:22.137978 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-a728db9b-70f5-4be2-bef7-acdfeeeda2ea admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.077740 Sep 04 01:04:22.138466 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:04:22 2022] GET /compute/v2.1/os-services => generated 785 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:04:33.383180 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:33.384197 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 04 01:04:33.384645 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:04:33.525526 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell0:SELECT=4 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:33.526245 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell1:SELECT=4 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:33.526850 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=8 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:04:33.575532 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:33.579062 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:33.579530 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:33.579956 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:33.580698 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:33.581141 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:33.581550 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:33.609112 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-3f23cc93-516e-4b60-bc5d-aeda0083397b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.087947 Sep 04 01:04:33.609756 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:04:33 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:04:34.424502 dv-cinder-master-3-smb devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:34.425547 dv-cinder-master-3-smb devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-71461e07-820e-4327-a3bd-ffa36a5123fc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 04 01:04:34.425948 dv-cinder-master-3-smb devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Sep 4 01:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:04:34.613712 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:04:34.617646 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:34.618122 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:34.618586 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:34.619294 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:04:34.619740 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:04:34.620157 dv-cinder-master-3-smb devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:04:34.642107 dv-cinder-master-3-smb devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-e2f6542f-435e-4325-8252-afa12b5e6d35 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.079242 Sep 04 01:04:34.642920 dv-cinder-master-3-smb devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Sep 4 01:04:34 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:05:42.502455 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Sep 04 01:05:42.503476 dv-cinder-master-3-smb devstack@n-api.service[106075]: Sun Sep 4 01:05:42 2022 - graceful shutdown triggered... Sep 04 01:05:42.503945 dv-cinder-master-3-smb devstack@n-api.service[106077]: Gracefully killing worker 2 (pid: 106077)... Sep 04 01:05:42.504365 dv-cinder-master-3-smb devstack@n-api.service[106076]: Gracefully killing worker 1 (pid: 106076)... Sep 04 01:05:43.503814 dv-cinder-master-3-smb devstack@n-api.service[106075]: worker 1 buried after 1 seconds Sep 04 01:05:43.504291 dv-cinder-master-3-smb devstack@n-api.service[106075]: worker 2 buried after 1 seconds Sep 04 01:05:43.504291 dv-cinder-master-3-smb devstack@n-api.service[106075]: goodbye to uWSGI. Sep 04 01:05:43.505508 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Sep 04 01:05:43.506070 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Sep 04 01:05:43.508824 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 04 01:05:43.519808 dv-cinder-master-3-smb devstack@n-api.service[121082]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 4 01:05:43 2022] *** Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: nodename: dv-cinder-master-3-smb Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: machine: x86_64 Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: clock source: unix Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: pcre jit disabled Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: detected number of CPU cores: 4 Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: current working directory: / Sep 04 01:05:43.522519 dv-cinder-master-3-smb devstack@n-api.service[121082]: detected binary path: /usr/bin/uwsgi-core Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: your processes number limit is 47680 Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: your memory page size is 4096 bytes Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: detected max file descriptor number: 2048 Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: lock engine: pthread robust mutexes Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: thunder lock: enabled Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 04 01:05:43.523282 dv-cinder-master-3-smb devstack@n-api.service[121082]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 04 01:05:43.562841 dv-cinder-master-3-smb devstack@n-api.service[121082]: Python main interpreter initialized at 0x559bb83379c0 Sep 04 01:05:43.562841 dv-cinder-master-3-smb devstack@n-api.service[121082]: python threads support enabled Sep 04 01:05:43.562841 dv-cinder-master-3-smb devstack@n-api.service[121082]: your server socket listen backlog is limited to 100 connections Sep 04 01:05:43.562841 dv-cinder-master-3-smb devstack@n-api.service[121082]: your mercy for graceful operations on workers is 90 seconds Sep 04 01:05:43.563231 dv-cinder-master-3-smb devstack@n-api.service[121082]: mapped 403077 bytes (393 KB) for 2 cores Sep 04 01:05:43.563300 dv-cinder-master-3-smb devstack@n-api.service[121082]: *** Operational MODE: preforking *** Sep 04 01:05:43.563542 dv-cinder-master-3-smb devstack@n-api.service[121082]: *** uWSGI is running in multiple interpreter mode *** Sep 04 01:05:43.563542 dv-cinder-master-3-smb devstack@n-api.service[121082]: spawned uWSGI master process (pid: 121082) Sep 04 01:05:43.563764 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 04 01:05:43.564292 dv-cinder-master-3-smb devstack@n-api.service[121082]: spawned uWSGI worker 1 (pid: 121098, cores: 1) Sep 04 01:05:43.564637 dv-cinder-master-3-smb devstack@n-api.service[121082]: spawned uWSGI worker 2 (pid: 121099, cores: 1) Sep 04 01:05:43.564979 dv-cinder-master-3-smb devstack@n-api.service[121082]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 04 01:05:44.235793 dv-cinder-master-3-smb devstack@n-api.service[121099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 01:05:44.251292 dv-cinder-master-3-smb devstack@n-api.service[121098]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 01:05:45.400928 dv-cinder-master-3-smb devstack@n-api.service[121099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 01:05:45.400928 dv-cinder-master-3-smb devstack@n-api.service[121099]: from cryptography.utils import int_from_bytes Sep 04 01:05:45.401550 dv-cinder-master-3-smb devstack@n-api.service[121099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 01:05:45.401550 dv-cinder-master-3-smb devstack@n-api.service[121099]: from cryptography.utils import int_from_bytes Sep 04 01:05:45.410148 dv-cinder-master-3-smb devstack@n-api.service[121098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 01:05:45.410148 dv-cinder-master-3-smb devstack@n-api.service[121098]: from cryptography.utils import int_from_bytes Sep 04 01:05:45.410597 dv-cinder-master-3-smb devstack@n-api.service[121098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 01:05:45.410597 dv-cinder-master-3-smb devstack@n-api.service[121098]: from cryptography.utils import int_from_bytes Sep 04 01:05:47.846587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 01:05:47.847145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 01:05:47.847436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 01:05:47.847678 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 01:05:47.847941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 01:05:47.848336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.849244 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.849574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.849911 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.850249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.850569 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.850900 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.851222 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.851566 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.851829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.852152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.852688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.853026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.853349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.853673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.854011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.854321 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.854653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.854978 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.855485 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.856960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.856960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.856960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.856960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.857319 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.857554 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.857882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.858195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.858521 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.858832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.859260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.859582 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.859906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.860240 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.860723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.861018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.861331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.861653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.861989 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.862301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.862660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.862970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.863295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.863622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.863931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.864804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.865125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.865452 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.865765 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.866262 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.866395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.866621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.866949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.867282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.867612 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.867868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.868119 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.868443 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.868794 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.869111 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.869421 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.869737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.870054 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.870366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.870691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.870990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.871299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.871623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.871941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.872269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.872614 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.872940 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.873357 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.873609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.873921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.874268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.874592 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.874904 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.875229 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.875556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.875867 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.876183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.876528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.876838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.877177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.877488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.877743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.878050 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.878362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.878687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.878997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.879307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.879657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.880005 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.880319 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.880745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.881067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.881380 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.882201 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.882520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.882835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.883151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.883461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 01:05:47.883917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.884006 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 01:05:47.884078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.884078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.884327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 01:05:47.884429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.884710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 01:05:47.884804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.884878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 01:05:47.885046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.885251 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.885429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.885581 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.885743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.885910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886236 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886388 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886710 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.886936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887091 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.887999 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888422 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888779 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.888931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.889083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.889224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.889371 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891611 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891754 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.891895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892518 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.892862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893782 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.893934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.894815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.895090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.895090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.895441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.895441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.895946 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.896097 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.896250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.896431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.896609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.896882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.897039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.897189 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.897338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.897486 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.897638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.897778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.897921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.898069 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.898217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.898374 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.898525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.898674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.898821 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.898969 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.899118 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.899276 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.899425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.899574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.899716 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.899863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.900054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.900209 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.900369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.900563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.900719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.900861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.901013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.901160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.901301 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.901447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.901588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.901727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.901876 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.902017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.902163 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.902314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.902460 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.902610 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.902770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.902919 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.903067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.903207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.903346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.903485 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.903636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.903776 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.903917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.904077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.904217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.904372 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.904537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.904695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.904837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.904985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.905133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.905133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.905441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.906364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.906533 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.906700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.906874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.907088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.907243 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.907391 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.907539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.907680 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.907833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.907975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.908123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.908264 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.908419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.908617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.908828 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.908977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.909118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.909265 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.909412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.909559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.909712 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.909860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.910000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.910146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.910298 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.910451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.910451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.910741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.910741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.911103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.911259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.911413 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.911413 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.911687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.911687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.911965 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.912105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.912258 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.912405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.912590 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.912740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.912890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.913038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.913193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.913343 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.913483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.913631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.913778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.914034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.914182 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.914322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.914475 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.914626 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.914765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.914914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.915054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.915194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.915333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.915473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.915622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.915917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.916069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.916069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.916344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.916514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.916672 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.916827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.916974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.917205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.917357 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.917504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.917652 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.917867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.918017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.918172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.918326 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.918474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.918615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.918772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.918941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.919090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.919231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.919379 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.919526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.919676 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.919825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.919965 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.920112 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.920301 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.920452 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.920704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.920863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.921015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.921163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.921317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.921458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.921604 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.921747 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.921886 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.922038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.922187 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.922328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.922467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.922617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.922766 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.922916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.923064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.923212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.923360 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.923500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.923640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.923790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.923944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.924085 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.924232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.924386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.924571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.924722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.924870 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.925010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.925157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.925298 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.925446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.925594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.925735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.926020 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.926172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.926322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.926984 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.927141 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.927370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.927581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.927732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.927872 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.928022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.928169 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.928317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.928500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.928661 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.928812 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.928961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.929111 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.929269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.929410 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.929558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.929713 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.929862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.930010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.930159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.930299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.930446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.930600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.930741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 01:05:47.930889 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931625 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.931912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932210 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932359 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932676 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.932984 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933134 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933438 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933579 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.933860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.934902 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935471 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.935920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936556 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936713 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.936873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937824 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.937974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938115 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938263 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.938994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939141 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939290 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.939860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.940866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941343 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.941939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.942117 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.942914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.943104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.943268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.943923 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.944782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.945766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.946054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.946328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.946497 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.946647 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.946813 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947014 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947649 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.947981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948137 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948468 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948774 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.948921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949090 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949246 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.949878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950494 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.950959 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951417 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.951873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952034 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952687 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.952841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953165 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953313 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953805 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.953966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.954893 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955775 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.955923 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956229 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956493 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.956964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.957118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.957277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.957425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.957573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958091 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958562 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958709 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.958863 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959657 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.959992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960353 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960530 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960685 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.960947 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961037 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961129 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961596 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961680 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.961939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962189 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962532 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962714 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962894 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.962985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963246 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963783 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.963955 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964039 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964604 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.964941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965034 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965126 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965218 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965430 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965522 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.965973 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966323 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966655 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.966925 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967009 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967098 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967372 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.967971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968141 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968510 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.968981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969175 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969864 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.969959 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.970919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971138 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971448 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971757 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.971871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972718 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.972821 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.973983 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974402 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974611 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974728 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.974918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975016 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975339 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.975957 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976175 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976653 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976822 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.976913 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977129 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977540 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.977841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978060 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978677 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978784 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.978985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979604 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.979909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980007 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980656 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980861 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.980953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.981167 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.981329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.981482 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.981703 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.981793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.982021 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.982347 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.982673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.982856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.982982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983179 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983290 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983614 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983836 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.983932 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.984897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.985112 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.985202 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.986633 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.986745 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.986848 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.986948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987297 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987656 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987746 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987839 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.987938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988024 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988208 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.988532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990326 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990400 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990400 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990544 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990614 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.990916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991480 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.991933 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992771 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.992902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.993226 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.993350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.993545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.993688 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.993856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994166 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.994815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995134 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.995780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996312 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996652 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.996961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997052 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997363 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.997896 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998001 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.998939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999246 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999471 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999574 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999784 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:47.999917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000179 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000515 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.000843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001156 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001678 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.001990 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.002910 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003253 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003561 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003661 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003905 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.003997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.004240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.004339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.004615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.005288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.005458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.005577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.005785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.005894 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006518 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.006956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007430 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.007844 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.008841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009159 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009663 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.009978 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010602 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.010916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011668 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.011980 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.012156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.012407 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.012558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.012752 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.012852 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013477 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.013785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014718 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.014928 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.015027 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.015234 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.015336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.015560 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.015909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016242 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.016879 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017399 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.017803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018462 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018658 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.018964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019121 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.019919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.020103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.020278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.020545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.020812 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.020916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021224 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021565 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.021835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.022050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.022172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.022452 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.022749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.022850 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023178 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023781 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.023994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024422 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.024995 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025089 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025409 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.025957 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026049 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026680 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026898 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.026990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027308 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027524 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027635 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.027924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028142 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028232 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.028921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029419 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029524 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029734 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.029833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030708 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.030800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031121 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031714 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.031948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032128 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032348 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032596 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.032908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033220 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033312 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033530 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033629 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.033968 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034249 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.034871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035735 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.035847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036582 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.036901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037568 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.037883 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038717 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.038868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039024 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039517 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039839 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.039969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.040161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.040302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.040523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.040691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.040854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041538 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.041854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042066 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042472 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042681 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.042946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043602 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043694 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043906 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.043996 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.044974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045499 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045600 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.045918 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046137 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046235 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.046926 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.047135 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.047227 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.047477 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.047579 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.047847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.048931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049265 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049497 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.049819 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050349 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050658 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.050976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.051066 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.051291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.051383 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052120 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.052877 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053202 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.053853 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054074 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054513 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.054838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055671 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.055779 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056534 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.056974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.057206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.057304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.057537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.057636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.057860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058168 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058476 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058577 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058799 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.058889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059111 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059241 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.059836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060052 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060143 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060378 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060714 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.060805 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061328 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061427 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.061987 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.062949 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063265 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063601 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.063908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064129 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064586 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.064909 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065208 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065541 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.065833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066360 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066662 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.066968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.067728 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.067880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.067978 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068111 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068215 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.068847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069198 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069406 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.069816 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070139 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070438 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.070954 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071579 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.071992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072313 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072551 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.072973 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.073935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.074878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075189 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.075833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076049 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076140 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.076926 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077255 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077570 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.077983 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.078941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.079880 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.080091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.080324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.080699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.080849 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.080972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081244 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081338 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.081956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082272 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.082967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083590 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.083903 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084312 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.084972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085185 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085285 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085599 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.085914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086125 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086225 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086436 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.086844 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.087793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088767 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.088984 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.089087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.089412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.089519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.089730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.089823 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090704 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.090835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.091998 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092310 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092404 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092650 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.092999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093820 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.093946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094038 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094249 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094656 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.094970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.095423 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.095506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.095770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.095871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096189 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096582 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.096891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097060 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097370 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097463 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.097994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098132 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098328 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098750 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.098952 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099876 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.099976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100517 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100629 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.100989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101142 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101452 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.101853 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102405 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102497 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.102811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103463 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.103942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104600 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104706 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.104937 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105252 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.105907 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106627 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.106956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.107182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.107320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.107603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.107701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.107929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.108970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109287 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109717 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.109940 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110043 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110524 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110605 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110899 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.110989 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.111215 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.111300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112004 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112632 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112703 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112792 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.112924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.113079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.113252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.113402 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.113571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.113889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.114621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.114767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.115351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.115435 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.115678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.115773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.116982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.117934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118142 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118789 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.118878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.119211 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.119307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.119534 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.119743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 01:05:48.119856 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.120176 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.120520 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.120836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.121150 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.121464 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.121778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.122101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.122434 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.122750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.123059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.123478 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.123795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.124115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.124439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.124779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.125102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.125428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.125741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.126065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.126377 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.126709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.127069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.127377 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.127711 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.128098 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.128407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.128743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.129058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.129382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.130488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.130885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.131197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.131514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.131824 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.132134 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.132443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.132773 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.133087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.133395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.133704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.134012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.134318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.134626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.134932 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.135245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.135550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.135859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.136166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.136492 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.136804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.137137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.137472 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.137788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.138118 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.138433 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.138757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.139068 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.139394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.139716 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.140035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.140351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.140984 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.141299 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.141615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.141931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.142243 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.142557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.142869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.143201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.143530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.143837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.144165 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.144508 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.144836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.145159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.145607 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.145945 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.146263 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.146576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.146886 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.147202 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.147517 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.147841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.148156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.148482 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.148812 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.149130 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.149464 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.149792 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.150104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.150437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.150764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.151112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.151428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.151774 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.152104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.152421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.152761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.153067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 01:05:48.153310 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 01:05:48.185019 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO dbcounter [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Registered counter for database nova_api Sep 04 01:05:48.205487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.212518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.222658 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO dbcounter [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Registered counter for database nova_api Sep 04 01:05:48.243396 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.250493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writer thread running {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.276517 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.context [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=121099) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 01:05:48.280595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:05:48.281376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:05:48.283457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:05:48.284218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:05:48.284705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:05:48.287507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:05:48.289687 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO dbcounter [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Registered counter for database nova_cell0 Sep 04 01:05:48.294412 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO dbcounter [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Registered counter for database nova_cell1 Sep 04 01:05:48.303756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.305716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.308568 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.context [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=121098) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 01:05:48.312053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.312678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:05:48.313161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:05:48.313375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.314754 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:05:48.315580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:05:48.316027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:05:48.318237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:05:48.320342 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO dbcounter [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Registered counter for database nova_cell0 Sep 04 01:05:48.324634 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO dbcounter [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Registered counter for database nova_cell1 Sep 04 01:05:48.333748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.337064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.349246 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writer thread running {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.480560 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO dbcounter [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Registered counter for database nova_cell0 Sep 04 01:05:48.492725 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.497558 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.514152 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writer thread running {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.526170 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO dbcounter [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Registered counter for database nova_cell0 Sep 04 01:05:48.534893 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_db.sqlalchemy.engines [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 01:05:48.540672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writer thread running {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 01:05:48.884757 dv-cinder-master-3-smb devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 01:05:48.892676 dv-cinder-master-3-smb devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 01:05:48.902089 dv-cinder-master-3-smb devstack@n-api.service[121098]: WARNING keystonemiddleware.auth_token [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 01:05:48.911665 dv-cinder-master-3-smb devstack@n-api.service[121098]: WARNING keystonemiddleware.auth_token [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 01:05:49.271417 dv-cinder-master-3-smb devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 01:05:49.277645 dv-cinder-master-3-smb devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-35b968ea-3756-42ab-84c6-f9aec1cd4660 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 01:05:49.283035 dv-cinder-master-3-smb devstack@n-api.service[121099]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bb83379c0 pid: 121099 (default app) Sep 04 01:05:49.284680 dv-cinder-master-3-smb devstack@n-api.service[121098]: WARNING keystonemiddleware.auth_token [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 01:05:49.291479 dv-cinder-master-3-smb devstack@n-api.service[121098]: WARNING keystonemiddleware.auth_token [None req-3c19f20c-11df-483a-80ef-7689b3e7a432 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 01:05:49.296720 dv-cinder-master-3-smb devstack@n-api.service[121098]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bb83379c0 pid: 121098 (default app) Sep 04 01:06:25.938555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:25.938555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:25.938555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:25.939335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:26.972860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29e73dbc-7c2c-4e6a-a732-2b68d8c19bbc tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Action: 'create', calling method: .version_select at 0x7fba2598d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1309600011"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:28.990668 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29e73dbc-7c2c-4e6a-a732-2b68d8c19bbc tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.068980 Sep 04 01:06:28.992271 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Sep 4 01:06:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3072 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 04 01:06:29.009401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:29.010505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:29.011374 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:29.012611 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:06:29.340232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-80a1b376-8138-461d-a540-b58648d3009a tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba25a47f70>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:30.099760 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-80a1b376-8138-461d-a540-b58648d3009a tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 200 len: 345 microversion: 2.1 time: 1.093895 Sep 04 01:06:30.109517 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:29 2022] GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 345 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:31.118018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14ae78e6-1cbc-4b5b-90ed-894974ab4cbd tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2586c160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:31.235330 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14ae78e6-1cbc-4b5b-90ed-894974ab4cbd tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 200 len: 346 microversion: 2.1 time: 0.124040 Sep 04 01:06:31.236186 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:31 2022] GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:31.253225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ac2fd118-77f1-4e05-a2ba-7bea4570be79 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Action: 'create', calling method: .version_select at 0x7fba2584c3a0>, body: {"snapshot": {"volume_id": "d779789b-63a0-4e4f-a28b-dd3f9b0acdcb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-360396201"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:32.100144 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ac2fd118-77f1-4e05-a2ba-7bea4570be79 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.853335 Sep 04 01:06:32.101057 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 2/4] 10.222.0.27 () {60 vars in 1162 bytes} [Sun Sep 4 01:06:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:32.111503 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a5b2190-88f1-432a-8cbe-28b8a649da84 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2586c820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:32.212930 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a5b2190-88f1-432a-8cbe-28b8a649da84 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 200 len: 286 microversion: 2.1 time: 0.105020 Sep 04 01:06:32.214102 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:32 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:32.226208 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e74b3cd9-26f0-4025-86e6-b92f591babc1 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2584c040>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:32.361093 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e74b3cd9-26f0-4025-86e6-b92f591babc1 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.139717 Sep 04 01:06:32.372780 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1140 bytes} [Sun Sep 4 01:06:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:32.374411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36b194aa-fbc4-4ec0-9450-f559f13277a0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2586cf70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:32.417374 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36b194aa-fbc4-4ec0-9450-f559f13277a0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 200 len: 286 microversion: 2.1 time: 0.047405 Sep 04 01:06:32.418314 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:32 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:33.431026 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7e8a2477-f42a-4e4a-b56f-03cfdd989645 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f73a0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:33.495174 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7e8a2477-f42a-4e4a-b56f-03cfdd989645 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 200 len: 286 microversion: 2.1 time: 0.068176 Sep 04 01:06:33.501900 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:33 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:34.507934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d7af79a-5221-4d21-a122-a57b73d53eb6 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2586caf0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:34.648050 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d7af79a-5221-4d21-a122-a57b73d53eb6 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 200 len: 287 microversion: 2.1 time: 0.144894 Sep 04 01:06:34.648635 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:34 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:34.660727 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-24f6d9b4-2502-493c-83d0-fe86a6ba9857 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2585c790>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:34.938627 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-24f6d9b4-2502-493c-83d0-fe86a6ba9857 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 202 len: 0 microversion: 2.1 time: 0.282224 Sep 04 01:06:34.939329 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Sep 4 01:06:34 2022] DELETE /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:06:34.947892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38adebcc-bb0f-4b2a-abb8-2666fad0987b tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba2586c430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:35.002758 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38adebcc-bb0f-4b2a-abb8-2666fad0987b tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 200 len: 286 microversion: 2.1 time: 0.058577 Sep 04 01:06:35.008832 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:34 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:36.015426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-282f1914-5abf-4658-8986-3f437a150f94 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba25892ee0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:36.062214 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-282f1914-5abf-4658-8986-3f437a150f94 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] HTTP exception thrown: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-282f1914-5abf-4658-8986-3f437a150f94 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Request method failure captured: Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd HTTP/1.1 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oR8-Dk1uqUFa4Su9qQGGB-x1fy7acqBsmcc5wdIAQfCTl3GpwBV7HKH_9mWj3abcpyY2Qb87zJtaNcKlZCSxiF3VIePKEtUqbCRxMSXxB2Vdw1gFnNt0iKo5irxROXBkNH_hrC8pbAgTzXIe1SWeVzsah4zcTLSySdvtHW0HZ8dMc Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:06:36.068257 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a390896075b4d7fb32eb2bfd80f2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: b5e4b2720c0645b6b8c20974f28412ea Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '21b1989d-f4ef-418e-81ec-4a4e16e99cfd'} Sep 04 01:06:36.069461 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. (HTTP 404) (Request-ID: req-0ac3495e-0750-469b-941b-8ad8c9a34a95) Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.070186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:36.071257 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 04 01:06:36.072220 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-282f1914-5abf-4658-8986-3f437a150f94 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Returning 404 to user: Snapshot 21b1989d-f4ef-418e-81ec-4a4e16e99cfd could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:06:36.073452 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-282f1914-5abf-4658-8986-3f437a150f94 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd" status: 404 len: 111 microversion: 2.1 time: 0.058618 Sep 04 01:06:36.078356 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d725b877-1ca3-4233-a8f0-f216c0ff283a tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f7040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:36.092829 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Sep 4 01:06:36 2022] GET /compute/v2.1/os-snapshots/21b1989d-f4ef-418e-81ec-4a4e16e99cfd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:06:36.397478 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d725b877-1ca3-4233-a8f0-f216c0ff283a tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 202 len: 0 microversion: 2.1 time: 0.322686 Sep 04 01:06:36.398198 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:06:36 2022] DELETE /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 01:06:36.406592 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-693a68eb-2344-4bdb-80c1-d7925106f15d tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f71f0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:36.542673 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-693a68eb-2344-4bdb-80c1-d7925106f15d tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 200 len: 345 microversion: 2.1 time: 0.140275 Sep 04 01:06:36.553185 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:36 2022] GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:06:37.559545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d46050ef-157f-4b7c-b7ff-a113bbbf1fb0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f7700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:37.858366 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d46050ef-157f-4b7c-b7ff-a113bbbf1fb0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] HTTP exception thrown: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d46050ef-157f-4b7c-b7ff-a113bbbf1fb0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Request method failure captured: Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb HTTP/1.1 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oR8-Dk1uqUFa4Su9qQGGB-x1fy7acqBsmcc5wdIAQfCTl3GpwBV7HKH_9mWj3abcpyY2Qb87zJtaNcKlZCSxiF3VIePKEtUqbCRxMSXxB2Vdw1gFnNt0iKo5irxROXBkNH_hrC8pbAgTzXIe1SWeVzsah4zcTLSySdvtHW0HZ8dMc Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:06:37.864946 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a390896075b4d7fb32eb2bfd80f2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: b5e4b2720c0645b6b8c20974f28412ea Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'd779789b-63a0-4e4f-a28b-dd3f9b0acdcb'} Sep 04 01:06:37.866432 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. (HTTP 404) (Request-ID: req-1bce2657-c336-458d-af78-4b0d231805d4) Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.867213 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:37.868257 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 01:06:37.873464 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d46050ef-157f-4b7c-b7ff-a113bbbf1fb0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Returning 404 to user: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d46050ef-157f-4b7c-b7ff-a113bbbf1fb0 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 404 len: 109 microversion: 2.1 time: 0.316121 Sep 04 01:06:37.874298 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:37 2022] GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 109 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:06:37.883404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1e34143c-d46c-4e86-ad9a-ef17db146951 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f7e50>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:37.930870 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-1e34143c-d46c-4e86-ad9a-ef17db146951 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] HTTP exception thrown: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1e34143c-d46c-4e86-ad9a-ef17db146951 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Request method failure captured: Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb HTTP/1.1 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oR8-Dk1uqUFa4Su9qQGGB-x1fy7acqBsmcc5wdIAQfCTl3GpwBV7HKH_9mWj3abcpyY2Qb87zJtaNcKlZCSxiF3VIePKEtUqbCRxMSXxB2Vdw1gFnNt0iKo5irxROXBkNH_hrC8pbAgTzXIe1SWeVzsah4zcTLSySdvtHW0HZ8dMc Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:06:37.935196 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a390896075b4d7fb32eb2bfd80f2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: b5e4b2720c0645b6b8c20974f28412ea Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'd779789b-63a0-4e4f-a28b-dd3f9b0acdcb'} Sep 04 01:06:37.936274 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. (HTTP 404) (Request-ID: req-63d0a769-0c5a-4f66-aeaf-3d0df00f0c70) Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.936913 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:06:37.937767 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 01:06:37.938654 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1e34143c-d46c-4e86-ad9a-ef17db146951 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Returning 404 to user: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1e34143c-d46c-4e86-ad9a-ef17db146951 tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 404 len: 109 microversion: 2.1 time: 0.058318 Sep 04 01:06:37.939511 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:06:37 2022] DELETE /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:06:37.955570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d82fa24-37cd-4daa-8d70-22aa9e6fba3c tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Calling method '.version_select at 0x7fba257f7b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:38.028988 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3d82fa24-37cd-4daa-8d70-22aa9e6fba3c tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] HTTP exception thrown: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d82fa24-37cd-4daa-8d70-22aa9e6fba3c tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Request method failure captured: Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb HTTP/1.1 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oR8-Dk1uqUFa4Su9qQGGB-x1fy7acqBsmcc5wdIAQfCTl3GpwBV7HKH_9mWj3abcpyY2Qb87zJtaNcKlZCSxiF3VIePKEtUqbCRxMSXxB2Vdw1gFnNt0iKo5irxROXBkNH_hrC8pbAgTzXIe1SWeVzsah4zcTLSySdvtHW0HZ8dMc Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:06:38.031758 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a390896075b4d7fb32eb2bfd80f2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a390896075b4d7fb32eb2bfd80f2431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5a390896075b4d7fb32eb2bfd80f2431 Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-629931210 Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: b5e4b2720c0645b6b8c20974f28412ea Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-629931210-project Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'd779789b-63a0-4e4f-a28b-dd3f9b0acdcb'} Sep 04 01:06:38.033576 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. (HTTP 404) (Request-ID: req-d9758919-f3b6-4f27-9a8a-39f4470caa55) Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:38.034807 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:38.035777 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 01:06:38.036705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. Sep 04 01:06:38.037582 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:06:38.040705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d82fa24-37cd-4daa-8d70-22aa9e6fba3c tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] Returning 404 to user: Volume d779789b-63a0-4e4f-a28b-dd3f9b0acdcb could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:06:38.041743 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d82fa24-37cd-4daa-8d70-22aa9e6fba3c tempest-VolumesSnapshotsTestJSON-629931210 tempest-VolumesSnapshotsTestJSON-629931210-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb" status: 404 len: 109 microversion: 2.1 time: 0.099051 Sep 04 01:06:38.042552 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:37 2022] GET /compute/v2.1/os-volumes/d779789b-63a0-4e4f-a28b-dd3f9b0acdcb => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:06:41.154298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-818684b3-7521-4b4a-9a28-febe538e5605 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: .version_select at 0x7fba257f7790>, body: {"keypair": {"name": "tempest-keypair-1893355089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41vn4lS5oj3ZM9c/b7yfP+s/KaQ08QRTR30OrE4S3PePf8AeumB5hovYYImlO7TH++KFC8qX16/6zKXtYBjeZr5Y+SeritWtEEFUiyLPcrDsVu2SB/BTRav+Eu25pjoA=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:41.344676 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-818684b3-7521-4b4a-9a28-febe538e5605 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:41.379858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-818684b3-7521-4b4a-9a28-febe538e5605 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for user bd1c41fcdc724a128117a5288b8559f5 and project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:41.593833 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-818684b3-7521-4b4a-9a28-febe538e5605 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.835409 Sep 04 01:06:41.603727 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 9/18] 10.222.0.27 () {62 vars in 1200 bytes} [Sun Sep 4 01:06:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 847 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 04 01:06:43.760053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42b083be-cd15-4e7f-8266-9183f89e1032 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: .version_select at 0x7fba257f7dc0>, body: {"keypair": {"name": "tempest-keypair-1330010867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaVwlNb3i03up3JslGCjrSpNgjTNwyllfr6WdWDJR+fXK25MXs4pLdSVfy3pqZ/xZzRxUyYDcJxuXIjdrH9wS1RECx3OzCuZ9cIjAaFGKva9rLOEW6B0c/qJmGIiaxbOQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:43.919123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-42b083be-cd15-4e7f-8266-9183f89e1032 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:43.952429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-42b083be-cd15-4e7f-8266-9183f89e1032 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:44.213617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1370046730", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:44.242693 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42b083be-cd15-4e7f-8266-9183f89e1032 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.941287 Sep 04 01:06:44.243710 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 10/19] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:06:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:44.392602 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] validate_networks() for [('db02f1f3-e31f-46bf-8240-058198049bb3', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:06:45.261210 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1446788581", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "1b4b6b61-4861-40b2-90db-a48723573c2e"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:45.442066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] validate_networks() for [('1b4b6b61-4861-40b2-90db-a48723573c2e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:06:46.477576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:06:46.478191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:06:46.478592 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:06:46.479009 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:06:46.479398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:06:46.492129 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:46.492971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:46.493567 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:46.495162 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:46.498968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:46.510393 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:46.607232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:46.619708 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for user 9bef8dc1da4c44dbbafcaf3c813b3262 and project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:46.650053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:06:46.653810 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:06:46.895440 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-244c26a8-8e07-478e-b340-91cc886e1d46 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.334163 Sep 04 01:06:46.898918 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:06:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:06:47.427003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:06:47.428640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:06:47.429424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:06:47.430313 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:06:47.430895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:06:47.454548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:47.455037 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:47.455509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:47.471996 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:47.472148 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:47.472644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:47.566571 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Getting quotas for project 3acb006051604f59a1ddcf7a8e7145da. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:47.578415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Getting quotas for user a28ff717beef47189f1d005fe7f65a10 and project 3acb006051604f59a1ddcf7a8e7145da. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:47.625655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:06:47.630081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:06:47.865126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9c163576-78cc-4042-adfe-7958933cf709 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Action: 'create', calling method: .version_select at 0x7fba25686af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1845343767", "metadata": {"Type": "work"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:47.935578 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2edfff8f-cefb-4daf-a365-e25cb82e4229 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.203598 Sep 04 01:06:47.936708 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 11/21] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:06:47.952880 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e0defb0-ac23-4c2f-8fad-3a09284d241d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:47.954151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e0defb0-ac23-4c2f-8fad-3a09284d241d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:48.229691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e0defb0-ac23-4c2f-8fad-3a09284d241d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:48.294632 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e0defb0-ac23-4c2f-8fad-3a09284d241d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1222 microversion: 2.1 time: 0.354947 Sep 04 01:06:48.298286 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 12/22] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:47 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:48.351418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20987b2c-7f38-45d0-b6ef-91868a24baf7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:48.352362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20987b2c-7f38-45d0-b6ef-91868a24baf7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:48.541905 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-20987b2c-7f38-45d0-b6ef-91868a24baf7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:48.550514 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20987b2c-7f38-45d0-b6ef-91868a24baf7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1215 microversion: 2.1 time: 0.222227 Sep 04 01:06:48.566617 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:48 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:48.618735 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-677521399", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761493cb-9c37-4208-8cf3-32be61673510"}], "security_groups": [{"name": "tempest-securitygroup--883373104"}], "key_name": "tempest-keypair-1893355089", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:49.234036 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] validate_networks() for [('761493cb-9c37-4208-8cf3-32be61673510', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:06:49.435717 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9c163576-78cc-4042-adfe-7958933cf709 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.535239 Sep 04 01:06:49.437342 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 11/24] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Sep 4 01:06:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2538 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 04 01:06:49.443523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012347655", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:49.589483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] validate_networks() for [('db02f1f3-e31f-46bf-8240-058198049bb3', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:06:49.947174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:06:49.949632 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:06:49.950684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:06:49.954770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:06:49.954770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:06:49.968744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:49.969791 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:49.970697 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:49.974216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:49.975202 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:49.975891 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:50.007147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:50.014514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for user bd1c41fcdc724a128117a5288b8559f5 and project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:50.042342 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:06:50.046622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:06:50.311629 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-923c90b8-135e-4427-823c-a466aa9f5931 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.697236 Sep 04 01:06:50.316498 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 14/25] 10.222.0.27 () {62 vars in 1188 bytes} [Sun Sep 4 01:06:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 04 01:06:50.329785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ccd0bc6-a1f9-4584-889c-32a823338300 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba256b05e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:50.446261 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ccd0bc6-a1f9-4584-889c-32a823338300 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 200 len: 353 microversion: 2.1 time: 0.128394 Sep 04 01:06:50.447858 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 15/26] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:50 2022] GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:50.453449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-374b9350-cb3c-4f38-b09f-02ae48794735 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:50.454534 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-374b9350-cb3c-4f38-b09f-02ae48794735 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:50.487360 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:06:50.488576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:06:50.489341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:06:50.490077 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:06:50.490689 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:06:50.501610 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:50.502503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:50.503329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:50.504912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:50.505595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:50.506259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:50.538035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:50.544632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for user 9bef8dc1da4c44dbbafcaf3c813b3262 and project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:50.560169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:06:50.572752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:06:50.578296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-374b9350-cb3c-4f38-b09f-02ae48794735 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:50.588215 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-374b9350-cb3c-4f38-b09f-02ae48794735 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1215 microversion: 2.1 time: 0.139223 Sep 04 01:06:50.602049 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 16/27] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:50 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:50.612851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:50.613840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:50.744864 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:50.757644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:50.759375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:50.762851 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37438a1b-6c03-406a-a1cd-d20c9f84b1fc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1281 microversion: 2.20 time: 0.157078 Sep 04 01:06:50.765125 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 17/28] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:50 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:50.771587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-685679428", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b20c706-eedb-40a9-af04-eb1e93ffe3a6"}], "security_groups": [{"name": "tempest-securitygroup--1201080884"}], "key_name": "tempest-keypair-1330010867", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:06:50.795788 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b2c0ba17-b775-4489-b8ed-00992ab91b9d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.352600 Sep 04 01:06:50.796736 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 12/29] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:06:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:06:50.809604 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d853cb02-f029-47a0-8826-a8d98e1699e6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:50.812281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d853cb02-f029-47a0-8826-a8d98e1699e6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:50.949275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d853cb02-f029-47a0-8826-a8d98e1699e6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:50.982063 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d853cb02-f029-47a0-8826-a8d98e1699e6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1222 microversion: 2.1 time: 0.176989 Sep 04 01:06:50.983523 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 13/30] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:50 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:06:51.096723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] validate_networks() for [('2b20c706-eedb-40a9-af04-eb1e93ffe3a6', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:06:51.463585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f3c72719-e86b-4027-9c4b-27cf14a8646b tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba256a1d30>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:51.531135 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f3c72719-e86b-4027-9c4b-27cf14a8646b tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 200 len: 354 microversion: 2.1 time: 0.073521 Sep 04 01:06:51.541061 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 14/31] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:51 2022] GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:06:51.566558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-054d5b15-ce66-4113-a78b-68074a489752 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba24e44820>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:51.642312 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-054d5b15-ce66-4113-a78b-68074a489752 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 200 len: 354 microversion: 2.1 time: 0.094793 Sep 04 01:06:51.643538 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 15/32] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:51 2022] GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:51.653489 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:51.654442 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:51.673076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:51.675757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:51.676242 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:51.678551 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:51.680596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:51.681880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:51.879997 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:51.904187 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9a112523-441f-4093-8865-37343b4b1f2b tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1211 microversion: 2.1 time: 0.259192 Sep 04 01:06:51.920584 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:51 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1211 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:51.920584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fe119992-c845-4734-aa24-219c9430b046 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba24dcc5e0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.003742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:06:52.004530 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:06:52.005375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:06:52.006000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:06:52.007270 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:06:52.019491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.020312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.021020 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.022798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.023479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.024284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.045371 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:06:52.051468 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:06:52.065342 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:06:52.069150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:06:52.146687 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fe119992-c845-4734-aa24-219c9430b046 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 202 len: 0 microversion: 2.1 time: 0.236075 Sep 04 01:06:52.150308 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:06:51 2022] DELETE /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:06:52.154278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.157126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:52.177876 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.178466 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.178980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.179703 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.180223 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.180916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.360622 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0cae4795-51d3-4d92-a780-9abbb9c6a560 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.590288 Sep 04 01:06:52.362712 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 18/35] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:06:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:06:52.391248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.399233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:52.416199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.416730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.417177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.417883 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.418353 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.418767 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.444479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:52.468151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:52.469819 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:52.474930 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e427192e-62c6-43d7-a085-a150b4891ac0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1285 microversion: 2.20 time: 0.326154 Sep 04 01:06:52.475858 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 18/36] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:52 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:52.493834 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-afe8668d-0bdf-476d-875e-482b121ede81 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba24e44820>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.630514 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-afe8668d-0bdf-476d-875e-482b121ede81 tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 200 len: 353 microversion: 2.1 time: 0.153582 Sep 04 01:06:52.633019 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 19/37] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:52 2022] GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:06:52.637325 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5e338d86-6aad-4703-8503-191964634d61 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.638278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5e338d86-6aad-4703-8503-191964634d61 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:52.737062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:52.756727 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5e338d86-6aad-4703-8503-191964634d61 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:52.765429 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5e338d86-6aad-4703-8503-191964634d61 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1241 microversion: 2.1 time: 0.131572 Sep 04 01:06:52.767600 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:52 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:52.769760 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4c3bbd7-cd81-46d4-928c-ad83ffd557c4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1226 microversion: 2.1 time: 0.405689 Sep 04 01:06:52.771316 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:52 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1226 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:52.930183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:52.930885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:52.937821 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.938969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.940170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:52.941003 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:52.941684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:52.942205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:53.077165 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.091110 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8e768da3-9499-43bb-baf4-210d5e41f67f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1267 microversion: 2.1 time: 0.165625 Sep 04 01:06:53.094585 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:52 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:53.514991 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:53.515842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:53.530204 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:53.535912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:53.538192 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:53.540262 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:53.543243 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:53.546141 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:53.647010 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2b9433f5-33ec-41dd-a000-404d1970afbd tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Calling method '.version_select at 0x7fba24ddb8b0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:53.729951 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-2b9433f5-33ec-41dd-a000-404d1970afbd tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] HTTP exception thrown: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2b9433f5-33ec-41dd-a000-404d1970afbd tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Request method failure captured: Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 HTTP/1.1 Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_olPt8JyQb9QY9-R75kQHzd70-Ur_XuQkel5AL_VbPxT44-RsE1kyVcTR1ymAUj4w_kH6kCPUdX6HM7SxLM3vcXI759pUz2KN-iU_CoodDXNqrveTzq6LmKDX8Gk-gPkJc2K6l4YiY86CORmaQNZA25IrCw7T57BtJvT7Ow2AyylOA Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 2a59f67920fb433c8018ec4d98a87b8a Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesGetTestJSON-924494881 Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:06:53.731433 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a59f67920fb433c8018ec4d98a87b8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a59f67920fb433c8018ec4d98a87b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a59f67920fb433c8018ec4d98a87b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a59f67920fb433c8018ec4d98a87b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesGetTestJSON-924494881 Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 2a59f67920fb433c8018ec4d98a87b8a Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesGetTestJSON-924494881 Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesGetTestJSON-924494881-project Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 128e8929aef44054b4aa4e4dc7d13f20 Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesGetTestJSON-924494881-project Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '8472e965-d8b2-4f8b-a069-924fa6f286b7'} Sep 04 01:06:53.732929 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. (HTTP 404) (Request-ID: req-bbdbb51a-7ac4-44e4-81c7-878de06de68f) Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:53.733830 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:06:53.735002 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 01:06:53.738139 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2b9433f5-33ec-41dd-a000-404d1970afbd tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] Returning 404 to user: Volume 8472e965-d8b2-4f8b-a069-924fa6f286b7 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2b9433f5-33ec-41dd-a000-404d1970afbd tempest-VolumesGetTestJSON-924494881 tempest-VolumesGetTestJSON-924494881-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7" status: 404 len: 109 microversion: 2.1 time: 0.090590 Sep 04 01:06:53.740611 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 22/41] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:06:53 2022] GET /compute/v2.1/os-volumes/8472e965-d8b2-4f8b-a069-924fa6f286b7 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:06:53.796945 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.802083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-abae54ec-39fe-4889-8a76-5502a9d431ad tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:53.804095 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-abae54ec-39fe-4889-8a76-5502a9d431ad tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:53.833194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.843994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.845225 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7095b35-7921-4c41-b053-cddfc2e903be tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1333 microversion: 2.20 time: 0.342066 Sep 04 01:06:53.852889 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 20/42] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:53 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1333 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:53.874154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:53.879501 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:53.887022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:53.888603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:53.889559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:53.902550 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:53.903049 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:53.903491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:53.983306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-abae54ec-39fe-4889-8a76-5502a9d431ad tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.992101 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:53.992624 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-abae54ec-39fe-4889-8a76-5502a9d431ad tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1241 microversion: 2.1 time: 0.200012 Sep 04 01:06:53.992624 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:53 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:06:54.000133 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8e78b03-f646-4137-95e7-6d17f7644fab tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1274 microversion: 2.1 time: 0.146040 Sep 04 01:06:54.001166 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 21/44] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:53 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:54.121316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:54.122197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:54.129908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:54.130408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:54.141367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:54.149595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:54.151025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:54.153373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:54.483361 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:54.511097 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7d381e94-2654-477b-b2fd-c654ccbdf593 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1285 microversion: 2.1 time: 0.394561 Sep 04 01:06:54.516505 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 24/45] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:54 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1285 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:54.884105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:54.885527 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:54.893932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:54.894662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:54.895308 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:54.896269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:54.896958 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:54.897457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.015479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:55.018370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:55.048092 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.051666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.052128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.055631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.056118 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.058445 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.248855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:55.263565 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-71d03b11-c7ee-4ffb-a6ff-a90b2b208e9d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1245 microversion: 2.1 time: 0.251436 Sep 04 01:06:55.277796 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:55 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1245 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:06:55.295084 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:55.298390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:55.310577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.313960 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.316319 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.317353 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.321375 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.322059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.367601 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:55.380372 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:55.394004 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:55.397541 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db9bf87f-0209-43d7-8c8b-55593b2f297b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1341 microversion: 2.20 time: 0.517333 Sep 04 01:06:55.399244 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 22/47] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:54 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1341 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:55.536865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:55.537492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:55.552145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.552710 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.553169 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.558122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:55.562673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:55.563154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:55.947625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:55.959370 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-151e9a04-50b1-4000-8a37-662cf2522384 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1273 microversion: 2.1 time: 0.426819 Sep 04 01:06:55.962705 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:55 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1273 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:06:56.076225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:56.091377 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9a02efbe-1689-4088-8677-0c2b87530361 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1282 microversion: 2.1 time: 0.805647 Sep 04 01:06:56.091377 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 26/49] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:55 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1282 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:56.291228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:56.291912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:56.317318 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:56.318001 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:56.318494 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:56.319228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:56.327305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:56.331519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:56.430750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:56.430750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:56.440407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:56.440943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:56.445884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:56.446738 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:56.447400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:56.447992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:56.547783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:56.562549 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e227440-f97f-4339-a9ea-0c72cf91484b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1293 microversion: 2.1 time: 0.275502 Sep 04 01:06:56.564948 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 24/50] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:56 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:56.885805 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:56.900327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:56.903337 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:56.905350 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dda50f98-0c77-44b5-a859-6e769e11384f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1339 microversion: 2.20 time: 0.485995 Sep 04 01:06:56.905916 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 27/51] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:56 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1339 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:56.997106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:56.999192 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:57.015786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.016625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.017436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.025686 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.026569 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.027224 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.123351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:57.124131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:57.135523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.147866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.149190 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.152578 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.153192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.153759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.543554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:57.556397 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e7af5677-8edd-4797-8d91-1c6c86f592c6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1280 microversion: 2.1 time: 0.439126 Sep 04 01:06:57.557501 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 28/52] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:57 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1280 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:57.593660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:57.594354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:57.624850 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.625359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.630042 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.631045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.631512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.632100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.816227 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:57.833947 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-530f5210-56be-49b0-86e6-a33138f95fbf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1301 microversion: 2.1 time: 0.242891 Sep 04 01:06:57.834585 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 29/53] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:57 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1301 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:57.851878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:57.862423 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f824266-18b9-48e1-a25e-d78661ab2c2c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.869758 Sep 04 01:06:57.868195 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 25/54] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:56 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:57.936328 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:57.937217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:57.947239 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.950872 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.951970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:57.954408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:57.956353 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:57.958350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:58.323997 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:58.376063 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:58.378507 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:58.382895 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7bd0f6ca-bc0a-4381-a620-fa9691fbcecb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1339 microversion: 2.20 time: 0.450133 Sep 04 01:06:58.392848 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 30/55] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:57 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1339 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:06:58.579455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:58.580791 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:58.586742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:58.590648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:58.590648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:58.590648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:58.590648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:58.590989 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:58.864356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:58.872083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:58.894525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:58.897505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:58.900707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:58.900707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:58.906618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:58.908650 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:59.115308 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:59.156732 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-13512f2b-bc9b-47b5-9c05-0fd46fdf3e88 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1299 microversion: 2.1 time: 0.298331 Sep 04 01:06:59.175995 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 31/56] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:58 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1299 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:59.182367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:59.183144 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:59.191933 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:59.193191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:59.193799 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:59.194895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:59.195585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:59.196735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:59.594615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:59.611762 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f47b51a-d6c8-4f9e-a6f2-ed311200a651 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 1.034520 Sep 04 01:06:59.625784 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 26/57] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:58 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:06:59.644285 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:06:59.645609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:06:59.673249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:59.677075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:59.678107 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:59.682248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:06:59.683190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:06:59.684777 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:06:59.821236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:59.839893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:59.842091 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:06:59.847797 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8c210b4-1be1-4e69-b884-f963c438e26b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1339 microversion: 2.20 time: 0.228356 Sep 04 01:06:59.850363 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 27/58] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:06:59 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:00.192818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:00.192818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:00.196381 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:00.198876 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.205344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.205974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:00.208623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.209408 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.210783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:00.523808 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=4 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:00.638574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:00.656991 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fef63168-76c9-4e05-beca-6036d6ce8e53 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1299 microversion: 2.1 time: 0.477231 Sep 04 01:07:00.659304 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:00 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1299 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:00.675097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:00.681028 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:00.682237 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:00.689512 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-11d74dd9-84b7-42b5-9707-8e97c4530bf2 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 1.507836 Sep 04 01:07:00.690462 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 32/60] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:06:59 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:00.703622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.704125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.704639 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:00.714084 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.714624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.715065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:00.884122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:00.884904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:00.913617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.916099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.918170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:00.919147 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:00.924444 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:00.931446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:01.501114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:01.533668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:01.536649 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:01.544246 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f1f6d28b-9601-4dcf-b0ab-c8a960a20051 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.668589 Sep 04 01:07:01.548136 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:00 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:01.686242 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:01.686880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:01.689901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:01.708934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:01.708934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:01.708934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:01.708934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:01.712184 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:01.713645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:01.797178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:01.816236 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9247b5d5-911e-43be-b214-f468b6c072f4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 1.152342 Sep 04 01:07:01.832394 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 29/62] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:00 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:01.836528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:01.837164 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:01.862868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:01.863384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:01.863834 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:01.864618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:01.865107 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:01.865545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:02.033724 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:02.060031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=30 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:02.333230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:02.345478 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-468f64bf-de42-4d0b-8596-225eeae3cc7a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.526951 Sep 04 01:07:02.346593 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 30/63] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:01 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:02.849591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c63d7-e34c-4215-a9e0-bc69fe40f7d6", "tag": "e6762f01-9b63-4b08-a547-83d1ec09e9b6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:02.890118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:02.890880 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:02.891589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:02.903910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:02.920378 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-afe5a977-9fa1-4213-96f6-cba00e8eb5b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 1.238219 Sep 04 01:07:02.924220 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 34/64] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:01 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:02.930016 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:02.958855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:02.964641 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:02.965321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:02.965935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:02.966743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:02.967299 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:02.967778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:02.985038 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Creating event network-changed:e6762f01-9b63-4b08-a547-83d1ec09e9b6 for instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 on hv-cinder-maste Sep 04 01:07:02.985645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 04 01:07:02.986728 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-565025e2-2dc2-46f5-b2b3-81278274c747 req-8d0c727a-7545-4ba4-a41c-1c7deec3b97c service nova] Acquired lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 04 01:07:02.988000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:02.988525 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:02.989008 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:02.989789 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:02.990330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:02.990817 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.032289 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.compute.rpcapi [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 04 01:07:03.033317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] Releasing lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 04 01:07:03.077767 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56f7a6d9-7312-432e-b8dc-f38917eaa1be None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.729752 Sep 04 01:07:03.078654 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 31/65] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:03.666586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65105ce3-9ff8-4e32-909a-3068131ae3c8", "tag": "71a78a3b-1fca-47fc-964a-818c95e4c544"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:03.714461 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:03.717265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:03.719578 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.741665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:03.762355 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:03.771860 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] Creating event network-changed:71a78a3b-1fca-47fc-964a-818c95e4c544 for instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 on hv-cinder-maste Sep 04 01:07:03.772989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:03.776564 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d4d1b13c-ba12-4df7-be35-a4cb77746ca3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.848623 Sep 04 01:07:03.778333 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 35/66] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:02 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:03.786552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:03.787891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:03.797714 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5d595eeb-8e87-4d4f-818e-78a7f16e8733 req-dd6827e4-5666-4f73-8a62-1711a54793da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.717495 Sep 04 01:07:03.799206 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 32/67] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:03.806377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:03.808301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:03.821488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:03.822964 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:03.823625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.823749 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:03.824964 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:03.825646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:03.826412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.826772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:03.828503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.835924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:03.835924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:03.836755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:03.990666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=22 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:04.379060 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:04.427987 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8104b2b9-66e2-48d8-9466-fb474d3db55d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.586701 Sep 04 01:07:04.427987 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 33/68] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:03 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:04.427987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:04.427987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:04.445651 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:04.446154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:04.446597 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:04.447314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:04.452281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:04.453771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:04.528035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:04.536170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:04.542264 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-83ece0e6-0702-4d6b-a053-84f2c53ddde4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.761185 Sep 04 01:07:04.543476 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 36/69] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:03 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:04.813844 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:04.820719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:04.826659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:04.828859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:04.829314 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:04.831965 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:04.832431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:04.832884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:04.842861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:04.861570 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c30e15b-64a2-40c6-a9e1-76f2601ab636 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.455368 Sep 04 01:07:04.862174 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 34/70] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:04 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:05.161357 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e477c1-a604-4738-96c1-c984698ba6b6", "tag": "9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:05.193392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.193617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.194000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.229062 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] Creating event network-changed:9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae for instance 90e477c1-a604-4738-96c1-c984698ba6b6 on hv-cinder-maste Sep 04 01:07:05.235117 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-99acbd21-16d8-4691-95f8-a973bd607625 req-9fa16664-1e9c-4543-b428-9e5b7b198a5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081749 Sep 04 01:07:05.238927 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 35/71] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:05.418649 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:05.427217 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:05.427217 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:05.432976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:05.435150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.437445 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:05.438159 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.439577 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-942e7657-2fc8-49c4-9f3d-07aee12880bb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.631699 Sep 04 01:07:05.440422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.441678 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.442978 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.444971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.455564 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:04 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:05.501132 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:05.579096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:05.580039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:05.626759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.627613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.630027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.631508 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.637447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.637447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.778076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:05.786356 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e597534f-5706-4ddd-9e09-2d96e5516423 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.373735 Sep 04 01:07:05.822289 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 36/73] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:05 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:05.894269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:05.895116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:05.904265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.905271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.906026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:05.907493 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:05.908823 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:05.909478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:06.229075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:06.238728 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f99849d4-dcf7-4201-8acc-0f6b2161bd03 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.351820 Sep 04 01:07:06.239318 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 37/74] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:05 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:06.258623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}, {"name": "network-changed", "server_uuid": "c3ae8c6a-0583-43a7-b43d-d920ad04325f", "tag": "03ba5432-d158-4dfd-9e61-2dd4ffb23766"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:06.302701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:06.303125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:06.305162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:06.333643 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Creating event network-changed:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:07:06.334615 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] Creating event network-changed:03ba5432-d158-4dfd-9e61-2dd4ffb23766 for instance c3ae8c6a-0583-43a7-b43d-d920ad04325f on hv-cinder-maste Sep 04 01:07:06.348012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:06.357683 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-33f76b00-dc19-4972-be8e-6d185c6bbf85 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.791034 Sep 04 01:07:06.363613 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6f302ade-9a32-405e-bad7-d21487735220 req-d68e7c81-6025-41f0-91da-c520b8be6f77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123060 Sep 04 01:07:06.366779 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 38/75] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:05 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:06.376951 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 38/76] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:06.472588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:06.474910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:06.486999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:06.488177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:06.488643 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:06.489530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:06.490122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:06.490711 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:06.775441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:06.786214 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:06.788763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:06.790720 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-858e3950-ad63-4ce6-ad90-52705b673a2d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.326451 Sep 04 01:07:06.800565 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 39/77] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:06 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:06.810116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:06.811620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:06.846987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:06.848764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:06.850595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:06.852750 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:06.853245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:06.853673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.039749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:07.057831 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-166a07eb-bc0d-497f-8ba5-d6a214bea5a4 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.252054 Sep 04 01:07:07.072773 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 39/78] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:06 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:07.263485 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:07.264826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:07.272380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.272892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.273319 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.293040 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.293576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.294031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.397848 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:07.398657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:07.430549 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.430549 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.430549 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.430549 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.431187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.431187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.616356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:07.618726 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:07.626182 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3369a956-dbc5-4202-ab67-1033bb524f3e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.367487 Sep 04 01:07:07.626967 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae829d25-fcd8-4b62-a578-37019547472c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.232644 Sep 04 01:07:07.627479 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 40/79] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:07 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:07.633190 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 40/80] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:07 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:07.821912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:07.822577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:07.832791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.837991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.837991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:07.837991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:07.837991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:07.838324 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.085840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:08.086442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:08.100011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.100766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.101714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.102763 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.103831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.104647 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.389879 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:08.401442 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:08.405797 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:08.407074 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f08fb325-f83a-458f-aa86-76e31cbed009 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.588411 Sep 04 01:07:08.411643 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 41/81] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:07 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:08.420651 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:08.447165 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08d7e40c-bbf1-488e-8e13-0120c962697c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.359495 Sep 04 01:07:08.448099 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 41/82] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:08 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:08.650768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:08.652031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:08.659160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.659516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:08.660059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.660339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:08.660820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.661702 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.662296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.662860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.670855 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.678100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.678100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.678100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:08.678100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:08.679424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:08.906414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:08.914486 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc98f869-0830-4e9c-a61d-fb33e19e9466 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.259220 Sep 04 01:07:08.919957 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 42/83] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:08 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:09.005714 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:09.014466 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-31a77b4a-b3df-4f26-bbb4-4d4c90435b5a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.367901 Sep 04 01:07:09.015928 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 42/84] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:08 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:09.440598 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:09.441273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:09.447393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.448063 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.458741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:09.458741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.458741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.458741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:09.477472 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:09.478793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:09.485012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.489582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.489582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:09.489582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.489582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.489932 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:09.609861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:09.618822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:09.620276 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:09.621444 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-938e141e-0021-441f-b20a-f726b4a40d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.184817 Sep 04 01:07:09.625276 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 43/85] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:09 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:09.635562 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:09.645016 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-bfd453fd-29a8-4d15-ba00-38fbafc7c682 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.171335 Sep 04 01:07:09.645817 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 43/86] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:09 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:09.942929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:09.943548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:09.949718 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.950213 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.950719 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:09.951524 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:09.951893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:09.952322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.037937 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:10.038627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:10.050254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.050254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.050254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.050254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.050588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.050588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.130857 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.138934 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4ede2d5-200b-4f17-8633-9571a8a59370 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.200609 Sep 04 01:07:10.155494 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 44/87] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:09 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:10.283843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.306679 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f79dbf4d-eae4-46ae-8743-8b4188eeff9a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.259295 Sep 04 01:07:10.306679 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 44/88] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:10 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:10.647225 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:10.648368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:10.658418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.658418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.658418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.658418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.658853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.658853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.670135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:10.670868 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:10.680219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.680746 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.681181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.681878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:10.685193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:10.686973 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:10.885677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.899923 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6244f4a0-0c38-4981-82a1-1d8134c31343 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.233610 Sep 04 01:07:10.902737 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 45/89] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:10 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:10.936955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.953041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.953041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:10.953041 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1cb6ebaa-09e2-4c37-bc76-2a13137dedd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.305435 Sep 04 01:07:10.961691 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 45/90] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:10 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:11.163837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:11.164584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:11.170404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.173474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.173474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.173474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.173474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.173845 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.315012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:11.320045 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:11.320690 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:11.322800 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b64413f2-8936-412f-8100-96d8bafa3069 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.163128 Sep 04 01:07:11.323618 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 46/91] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:11 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:11.326613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.327105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.327589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.328273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.328766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.329191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.481214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:11.490112 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea16cf0c-61ca-496d-91e1-2deb35360900 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.173745 Sep 04 01:07:11.504121 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 46/92] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:11 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:11.929784 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:11.930856 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:11.941931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.942812 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.943739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.944889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:11.945667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:11.946448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:11.981980 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:11.984556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:12.011831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.014509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.015502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.018284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.027024 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.030756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.206404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.215403 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2ca63634-de1b-449d-aaea-7a49146911d6 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.292472 Sep 04 01:07:12.216139 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 47/93] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:11 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:12.244042 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.252186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.253670 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.254802 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a94b4fb-1681-4746-8a24-15e608a50ee1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.282515 Sep 04 01:07:12.255851 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 47/94] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:11 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:12.346208 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:12.346912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:12.353044 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.353596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.354031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.354802 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.355257 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.355705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.493347 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.501173 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-837d4b0e-1cca-4d94-8797-45826bde80da tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.159254 Sep 04 01:07:12.504498 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 48/95] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:12 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:12.515184 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:12.515784 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:12.522587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.523407 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.523836 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.524595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:12.525202 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:12.525621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:12.671207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:12.679945 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a3447f5-db4c-4110-954f-684a1e387233 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.168863 Sep 04 01:07:12.680798 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 48/96] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:12 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:13.239666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:13.240301 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:13.246385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.246859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.247292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.247964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.248415 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.248858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.281392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:13.291663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:13.301052 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.301541 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.301976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.302673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.303132 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.303556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.419188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.435884 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-01150b02-2a77-493f-a782-1b3ec4fcd5db tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.200580 Sep 04 01:07:13.436807 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 49/97] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:13 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:13.479994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.489782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.491247 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.492361 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0b0258a2-3fdf-4be1-8a17-f49827d7de9a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.214876 Sep 04 01:07:13.492961 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 49/98] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:13 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:13.527459 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:13.531261 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:13.535421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.536233 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.536693 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.537433 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.538104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.538579 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.670820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.678669 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2cb20572-c13d-4466-a242-09eedc95b074 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.156233 Sep 04 01:07:13.679236 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 50/99] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:13 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:13.703576 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:13.703890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:13.711934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.712426 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.712892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.713586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:13.714045 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:13.714470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:13.771178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:13.856856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:13.865427 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ff7a094-b99d-4682-95ff-a8ef8fb6d030 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.166090 Sep 04 01:07:13.866006 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 50/100] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:13 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:14.459306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:14.459938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:14.466011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.466790 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.467230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.467907 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.468354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.468814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.517876 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:14.518674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:14.524869 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.525345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.525778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.526458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.526906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.527323 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.629929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:14.643396 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dfcab973-f30c-4b0f-acb4-a477e9584e6d tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.187821 Sep 04 01:07:14.644308 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 51/101] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:14 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:14.683714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:14.692604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:14.694035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:14.695475 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d43d6e9-b584-436a-9f86-3523ce0d3024 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.182106 Sep 04 01:07:14.695723 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 51/102] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:14 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:14.701323 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:14.702013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:14.708693 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.709166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.709597 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.710319 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.710773 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.711192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.843295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:14.851182 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d7ecba34-3b2b-4b7b-bf67-572febcfb761 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.153633 Sep 04 01:07:14.852541 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 52/103] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:14 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:14.887177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:14.887790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:14.894159 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.894649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.895090 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:14.895786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:14.896243 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:14.896692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.033058 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:15.040819 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed9c7121-afd4-41e9-b047-dd9221369ef1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.157387 Sep 04 01:07:15.041386 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:14 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:15.666424 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:15.667038 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:15.672998 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.673514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.673955 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.674644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.675104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.675529 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.695145 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:15.728075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:15.728831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:15.743761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.743761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.743761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.743761 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.744056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.744056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.765349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:15.823574 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:15.832712 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-41e3d4b8-5cef-452e-a271-784c43b0ec4c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.170087 Sep 04 01:07:15.835551 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 53/105] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:15 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:15.878200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:15.879255 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:15.889871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.891595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.892909 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.893774 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:15.899228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:15.899228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:15.914264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:15.927869 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:15.927869 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:15.928481 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef7c8f1b-fccc-4fd2-bb73-e9b74ed05c22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.209895 Sep 04 01:07:15.940735 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 53/106] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:15 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:16.040406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:16.047864 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a18d71cc-8aac-4ee1-a698-a7ac22afa624 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.176009 Sep 04 01:07:16.048635 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 54/107] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:15 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:16.065088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:16.065701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:16.071970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.072475 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.072916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:16.073604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.074056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.074479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:16.213702 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:16.223250 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48c7eb70-365e-487c-9185-d0c8ebac9c18 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.162600 Sep 04 01:07:16.224501 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:16 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:16.869695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:16.870542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:16.879938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.880655 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.881313 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:16.882115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.882726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.883304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:16.956546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:16.958061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:16.964768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.965530 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.966110 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:16.966963 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:16.967561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:16.968133 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:17.102357 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.110350 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a3ea88b4-0478-47f1-8c43-ef99abf4b9c7 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.251898 Sep 04 01:07:17.111319 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 55/109] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:16 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:17.116731 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:17.117511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:17.124097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:17.124847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:17.126115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:17.127231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:17.127757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:17.128255 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:17.140281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.152985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.156031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.157348 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6259dd88-17e9-4b43-9396-56872fcf29ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.207302 Sep 04 01:07:17.165074 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 55/110] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:16 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:17.247055 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:17.248095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:17.255047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:17.255945 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:17.256562 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:17.257492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:17.258518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:17.259105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:17.295410 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.309033 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-288c6c2a-26b3-4a27-9de6-3745f645773b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.194858 Sep 04 01:07:17.310846 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 56/111] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:17 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:17.437793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:17.446280 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d1eb9a5-c01a-4fe0-bdea-fafb82ca38e8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.203067 Sep 04 01:07:17.448574 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 56/112] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:17 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:18.133608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:18.135074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:18.141617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.143153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.143813 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.144895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.145406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.146018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.182172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:18.182782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:18.190188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.190692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.191130 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.191830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.192496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.192936 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.389828 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.400930 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-01641fca-ad52-4301-8153-7856c1518b6a tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.270993 Sep 04 01:07:18.401517 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 57/113] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:18 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:18.411966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:18.412601 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:18.427768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.428252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.428725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.429411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.430321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.431730 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.480839 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.495248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.497543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.499220 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc7455b4-56f7-4945-bdf0-bccc249ea8f8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.320818 Sep 04 01:07:18.500885 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 57/114] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:18 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:18.507077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:18.507843 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:18.514771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.515545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.515977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.516852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:18.518041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:18.518473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:18.584778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.593585 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9b03f884-19bb-4790-b9e3-2899ba63f62a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.185451 Sep 04 01:07:18.594175 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 58/115] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:18 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:18.674319 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:18.681976 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55e4bc9a-98f0-4f0d-a8df-4ccdaa14eb6a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.179826 Sep 04 01:07:18.682540 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 58/116] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:18 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:19.427250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:19.428548 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:19.438975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.438975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.438975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.438975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.439803 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.439803 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.527433 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:19.528047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:19.540443 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.540986 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.541430 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.542127 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.542584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.543000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.637306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:19.652648 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6ae3fb58-2a60-44b2-86d2-95c4af2048fd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.229894 Sep 04 01:07:19.653240 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 59/117] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:19 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:19.664499 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:19.671591 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:19.682969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.683624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.684081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.684816 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.685274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.686605 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.800683 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:19.810321 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:19.812816 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:19.817236 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-064dcb52-25fa-4303-88fd-0df6389f7154 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.290638 Sep 04 01:07:19.818776 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 59/118] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:19 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:19.838232 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:19.838442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:19.845303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.846290 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.846742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.847946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:19.848505 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:19.848904 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:19.917350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:19.930731 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-048f766a-4795-4799-acd1-0feff32d10ad tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.270768 Sep 04 01:07:19.935055 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 60/119] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:19 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:20.072760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:20.098261 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6508326-3c73-47f1-ad4c-f81ddfdd425e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.263887 Sep 04 01:07:20.098261 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 60/120] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:19 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:20.286333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c63d7-e34c-4215-a9e0-bc69fe40f7d6", "name": "network-vif-plugged", "status": "completed", "tag": "e6762f01-9b63-4b08-a547-83d1ec09e9b6"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:20.304138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.304883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.305504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.328133 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Creating event network-vif-plugged:e6762f01-9b63-4b08-a547-83d1ec09e9b6 for instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 on hv-cinder-maste Sep 04 01:07:20.328870 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 04 01:07:20.330149 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b0a1a09b-f009-4be9-ac5b-a39a52bdd734 req-a4ae103e-3f5c-46cb-a12b-dcc45818ad3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=121098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 04 01:07:20.331830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.332296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.332935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.333656 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.334626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.334626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.344441 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.compute.rpcapi [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 04 01:07:20.345941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] Releasing lock "compute-rpcapi-router" {{(pid=121098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 04 01:07:20.365856 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-18420893-af76-4835-bbc6-1deb5e6754ee None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153339 Sep 04 01:07:20.366949 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 61/121] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:20.678658 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:20.679271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:20.685245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.685737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.686170 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.686858 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.687306 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.687731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.822078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:20.831023 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61682e42-1c78-4486-b9d1-1881c9c7d26f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.156043 Sep 04 01:07:20.831608 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 61/122] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:20 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:20.845801 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:20.846697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:20.853269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.853751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.854183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.854895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.855345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.855767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.958325 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:20.959570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:20.966456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.967707 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.968931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:20.971035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:20.972474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:20.973188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:21.006285 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:21.015090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:21.016587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:21.018409 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-609000a9-8016-43fe-ba7b-8cc736955ef8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.177873 Sep 04 01:07:21.033848 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 62/123] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:20 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:21.110700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:21.111311 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:21.117754 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:21.118237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:21.118715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:21.119401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:21.119846 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:21.120263 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:21.127375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:21.135287 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf3361bd-91ac-40fd-9ffb-80c578aee97a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.183764 Sep 04 01:07:21.135859 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 62/124] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:20 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:21.253124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:21.260724 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-65bc57c5-37f1-46e6-ab4e-a59f4f603f2c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.154089 Sep 04 01:07:21.261287 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 63/125] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:21 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:21.855601 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:21.856295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:21.863294 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:21.863943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:21.864491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:21.865244 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:21.865703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:21.866124 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.045042 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:22.046134 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.047348 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:22.054375 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.055189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.055828 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.057124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.057797 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.058434 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.060324 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ac561b2-6b7d-4f7d-96aa-01736f68628e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.209412 Sep 04 01:07:22.075984 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 63/126] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:21 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:22.159646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:22.160260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:22.166932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.167490 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.168275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.169015 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.169473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.169949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.210851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.233680 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.235303 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.237055 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2d05838a-4053-4cf5-a615-c1ec170118aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.195985 Sep 04 01:07:22.237723 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 64/127] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:22 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:22.286812 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:22.287786 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:22.294740 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.295553 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.296315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.297324 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.298028 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.299456 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.311031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.321735 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7566695-8428-4ffc-a197-039473c712c8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.166141 Sep 04 01:07:22.323445 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 64/128] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:22 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:22.382759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65105ce3-9ff8-4e32-909a-3068131ae3c8", "name": "network-vif-plugged", "status": "completed", "tag": "71a78a3b-1fca-47fc-964a-818c95e4c544"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:22.400122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:22.400628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:22.406273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:22.422464 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] Creating event network-vif-plugged:71a78a3b-1fca-47fc-964a-818c95e4c544 for instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 on hv-cinder-maste Sep 04 01:07:22.430458 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-222310d9-e2d1-4ec6-a2b7-7754f9d40a60 req-f1d8b59b-c71c-43d1-a089-fcf2ef4b198a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051420 Sep 04 01:07:22.432094 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 65/129] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:22.467252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:22.475288 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-af9d012b-fada-465b-8d30-2bcf7de1e53f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.193818 Sep 04 01:07:22.475919 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 65/130] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:22 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:23.086299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:23.087617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:23.094990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.096731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.097177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.097872 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.098594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.098773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.243306 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.251079 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bbed41d9-477e-49af-b2a7-2d2a414ab495 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.169805 Sep 04 01:07:23.252545 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 66/131] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:23 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:23.262124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:23.262739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:23.269603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.270188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.270625 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.271314 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.271767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.272193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.344756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:23.346985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:23.353266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.353966 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.354572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.355411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.356002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.356649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.426091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.446751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.448595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.452702 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1f3faaf6-12ea-435a-af30-b765b6cb09a8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.193500 Sep 04 01:07:23.453420 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 66/132] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:23 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:23.498939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:23.499544 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:23.507806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.514453 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.517609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.517609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:23.517609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:23.517609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:23.655661 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.661160 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a83ebc68-9e3a-4681-bf2f-59f4fc9e1fb3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.320104 Sep 04 01:07:23.678544 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 67/133] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:23 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:23.767967 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:23.777361 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-04a7438a-6047-43ce-b4f9-70067ffe46e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.282083 Sep 04 01:07:23.778774 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 67/134] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:23 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:24.274773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:24.275374 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:24.282659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.283251 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.283879 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.284635 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.285092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.285502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.452948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e477c1-a604-4738-96c1-c984698ba6b6", "name": "network-vif-plugged", "status": "completed", "tag": "9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:24.469300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.470768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.471213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.496600 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] Creating event network-vif-plugged:9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae for instance 90e477c1-a604-4738-96c1-c984698ba6b6 on hv-cinder-maste Sep 04 01:07:24.508871 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-0178dd6d-66e7-4cef-9b95-a24e53a5b97f req-67eaa900-dec3-4eed-a837-aa95bb24670a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059036 Sep 04 01:07:24.514203 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:24.514365 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 68/135] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:07:24.523537 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99664062-21f8-42ac-b085-986d46aacb1e tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.253227 Sep 04 01:07:24.524631 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 68/136] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:24 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:24.527180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:24.529130 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:24.536436 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.538181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.538181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.538373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.538918 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.539486 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.687660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:24.690459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:24.699072 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.699572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.700154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.700894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.701341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.702078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.861772 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:24.870044 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6270659-aab1-446c-95ea-92aa8ac8b636 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.187056 Sep 04 01:07:24.870847 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 69/137] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:24 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:24.875515 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:24.876868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:24.883140 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.883776 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.889887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:24.890985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:24.891624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:24.892733 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:25.092923 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:25.102464 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:25.110517 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:25.115966 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7e7bbe2a-d857-4623-84e8-5ce8ad8c119e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.600191 Sep 04 01:07:25.120635 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 69/138] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:24 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:25.137838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:25.142873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:25.156948 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f89e1849-fef7-4fbc-9d3d-fa9c16bf8524 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.276797 Sep 04 01:07:25.157781 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 70/139] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:24 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:25.548807 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:25.552337 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:25.560508 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:25.562205 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:25.566951 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:25.568036 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:25.568769 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:25.569453 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:25.831356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:25.840114 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-19882d4f-3a88-4d75-ba2d-607f73a647fa tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.295775 Sep 04 01:07:25.859196 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 70/140] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:25 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:25.896030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:25.897482 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:25.914856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:25.917539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:25.917539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:25.917539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:25.917539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:25.917871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.142344 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:26.143326 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:26.151533 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.151951 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.152390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.153170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.153794 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.154216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.159373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:26.163296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:26.174535 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fb5093e-8ab9-4e07-80ae-cdd089fb3ce0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.283984 Sep 04 01:07:26.190944 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:25 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:26.199025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:26.199863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:26.207840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.208561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.209011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.209714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.210178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.210618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.335486 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:26.344406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:26.346922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:26.348186 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d042e1a2-85e1-49b6-98aa-abe4790ea212 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.210584 Sep 04 01:07:26.348810 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 71/142] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:26 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:26.378435 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:26.383016 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4364261a-b47c-4c7b-ac49-f895da05c855 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.190814 Sep 04 01:07:26.383923 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:26 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:26.551499 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ae8c6a-0583-43a7-b43d-d920ad04325f", "name": "network-vif-plugged", "status": "completed", "tag": "03ba5432-d158-4dfd-9e61-2dd4ffb23766"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:26.568216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.573775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.574608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.595468 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] Creating event network-vif-plugged:03ba5432-d158-4dfd-9e61-2dd4ffb23766 for instance c3ae8c6a-0583-43a7-b43d-d920ad04325f on hv-cinder-maste Sep 04 01:07:26.604874 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-a0b01e44-757e-49cc-9da8-47a8547cef54 req-9e74a0aa-bf79-4f9c-a6e3-94d91468897c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056644 Sep 04 01:07:26.605784 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 72/144] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:26.865759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:26.866486 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:26.872398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.873032 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.873527 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:26.874268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:26.874785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:26.875288 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.021825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.032973 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae665a83-3366-4371-bf24-6d28442f1e74 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.168026 Sep 04 01:07:27.034107 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 73/145] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:26 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:27.206428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:27.207421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:27.213797 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.219457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.219457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.219457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.219457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.220352 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.372972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:27.373592 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:27.380793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.385076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.385543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.386293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.386745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.387198 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.446797 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.461088 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-37cff8fc-23b8-4fe4-aa6d-232967aca5eb tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.259515 Sep 04 01:07:27.466568 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 73/146] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:27 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:27.486734 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:27.490744 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:27.499387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.499882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.500356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.501583 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:27.502309 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:27.503058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:27.635487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.646587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.651522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.651522 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f481083-e9af-4e76-97d6-9ac44eb1f4c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.280849 Sep 04 01:07:27.651522 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 74/147] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:27 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:27.711216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:27.718963 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d96b6008-c084-462c-874a-f2499eac4b77 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.240706 Sep 04 01:07:27.719534 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:27 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:28.056826 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:28.057510 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:28.066409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.066995 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.067372 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.068029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.068502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.068933 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.292119 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.310790 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68181f3e-a363-40b0-acd2-0e7292fc8bdd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1315 microversion: 2.1 time: 0.257857 Sep 04 01:07:28.311382 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:28 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:28.484648 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:28.485989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:28.493570 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.498351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.498351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.498351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.498351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.499251 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.637894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "name": "network-vif-plugged", "status": "completed", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:28.658677 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.659427 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.659929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.670117 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.682420 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] Creating event network-vif-plugged:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:07:28.685626 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a13ab8df-ea1c-43ba-bbd8-be4455dd9abc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1322 microversion: 2.1 time: 0.204832 Sep 04 01:07:28.686287 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:28 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:28.695863 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f78f77ab-1448-4240-8208-5647f33eecc8 req-f4acd6e5-a5cd-435f-94cf-0beceed7035f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062992 Sep 04 01:07:28.697374 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:28.700396 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:28.701282 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 76/151] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:07:28.714862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.715947 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.716702 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.717437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.718072 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.720960 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.743859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:28.744812 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:28.753406 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.754047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.754696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.755603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:28.756056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:28.756552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:28.889503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.899259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.900763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.901865 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-946377f1-7583-4709-a61d-b3e750e9ad19 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.213776 Sep 04 01:07:28.902413 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 76/152] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:28 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:28.944309 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:28.952898 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f90a480-f10b-466e-bdc6-37e95f63b316 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.213878 Sep 04 01:07:28.953507 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 77/153] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:28 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:29.344536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:29.345344 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:29.352441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.353245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.353749 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.354545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.355089 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.355612 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.492549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:29.500911 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d020b8f4-63fa-4c21-bfce-d65b3606b0f3 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1502 microversion: 2.1 time: 0.163687 Sep 04 01:07:29.501520 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 77/154] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:29 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:29.723162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:29.723777 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:29.729335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:29.731412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.732036 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.732536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.733188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.733817 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.734429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.911279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:29.919116 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f0a44da-5494-46a3-bca5-27c61dbd47d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1515 microversion: 2.1 time: 0.200580 Sep 04 01:07:29.919116 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 78/155] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:29 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:29.933766 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:29.934501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:29.941403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.941894 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.942336 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.943022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.943261 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:29.943476 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.943904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.946651 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:29.952676 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.953241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.957413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:29.957413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:29.957413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:29.957413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:30.068620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'flavor' on Instance uuid 90e477c1-a604-4738-96c1-c984698ba6b6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:07:30.134279 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:30.142580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:30.145668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:30.146972 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-640c96d1-0316-400f-8ae4-8fa04bb4af86 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.217095 Sep 04 01:07:30.147531 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 78/156] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:29 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:30.152044 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:30.152946 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:30.160327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:30.161079 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:30.161742 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:30.162788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:30.163468 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:30.164100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:30.344606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:30.359577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:30.368058 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-12dd391e-75ec-40bb-8cd8-4bf3665e12cd tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.219385 Sep 04 01:07:30.368684 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 79/157] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:30 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:30.537524 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad92eb00-1827-439d-8948-ef1727225017 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6/action" status: 200 len: 32 microversion: 2.1 time: 0.591933 Sep 04 01:07:30.537524 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 79/158] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:07:29 2022] POST /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6/action => generated 32 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:07:30.542918 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:30.543487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:30.553672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:30.554161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:30.554596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:30.555307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:30.555763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:30.556180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:30.741329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:30.764541 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e5aab40f-252a-435f-bfec-469daacdc7fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.222000 Sep 04 01:07:30.766781 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:30 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:31.177264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:31.178648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:31.194797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.195546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.196720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.198419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.199254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.200170 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.396021 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:31.396713 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:31.406146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.406729 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.407124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.407829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.408288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.415047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.699472 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:31.708760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:31.710772 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:31.711885 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c68a564-3a81-4640-a7d3-48cb5c8c77c4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.540421 Sep 04 01:07:31.722488 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 80/160] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:31 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:31.749315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:31.760203 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0597851e-c4e3-4cd2-92e7-07f2f6359831 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.367052 Sep 04 01:07:31.772128 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 81/161] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:31 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:31.789971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:31.790583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:31.800070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.800585 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.801029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.801760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:31.802215 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:31.802645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:31.948523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:31.960363 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebbf8005-471d-4757-a792-c7f390779886 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.174363 Sep 04 01:07:31.961239 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 81/162] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:31 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:32.497993 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a434b6b5-caa7-435d-be05-f44b48a23c1f"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:32.500411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:32.506561 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.507045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.507511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:32.508370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.508846 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.509269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:32.741087 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:32.741699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:32.747588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.748066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.748525 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:32.749381 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.749760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.750188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:32.902500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:32.910958 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:32.912523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:32.913621 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2adeef1-f855-4862-b1f2-2f80b2891e5e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.177078 Sep 04 01:07:32.914180 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 82/163] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:32 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:07:32.918539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:32.919149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:32.925269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.925743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.926174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:32.926844 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:32.927299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:32.927713 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:33.058918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:33.067296 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2d88590-af7a-40a5-8c37-25ffdb06d699 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1367 microversion: 2.1 time: 0.152162 Sep 04 01:07:33.067877 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 83/164] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:32 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:33.072409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:33.073068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:33.080877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:33.081349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:33.081782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:33.082465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:33.082914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:33.083387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:33.217975 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:33.227311 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afc4e267-11f8-460d-a8f5-a6dd87e1be5e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.158259 Sep 04 01:07:33.229295 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 84/165] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:33 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:33.942694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:33.943325 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:33.949988 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:33.950469 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:33.950898 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:33.951583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:33.952027 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:33.952637 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.126182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:34.136535 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:34.139152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:34.140390 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa9caa3d-875b-4ea1-84f0-5eb8edc10f3d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1406 microversion: 2.20 time: 0.205525 Sep 04 01:07:34.140973 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 85/166] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:33 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:34.152615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:34.153311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:34.165573 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.166096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.166708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.167603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.168159 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.168748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.173556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:34.339465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:34.364180 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d5298ce-2e0c-40b7-8b13-ea850523f7c6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1557 microversion: 2.1 time: 0.207278 Sep 04 01:07:34.364180 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 86/167] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:34 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:34.364180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:34.364180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:34.364180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.364807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.364807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.365158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.365477 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.366297 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.522970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:34.532678 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6fd0b5af-5e67-44f1-b270-61b6dfe3e027 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.180487 Sep 04 01:07:34.534859 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 87/168] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:34 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:34.541448 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:34.542268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:34.549942 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.550561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.550993 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.551679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:34.552151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:34.552609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:34.634302 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-439005a7-04c9-4e49-9098-4dd85f6866e1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097565 Sep 04 01:07:34.634894 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 88/169] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:07:34 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:35.169100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:35.169801 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:35.178051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.178768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.179195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.180055 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.180679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.181399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.562065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:35.570759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:35.572228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:35.573868 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dff0a516-a451-4d1e-92d4-a4ca6bc2007a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1596 microversion: 2.20 time: 0.409346 Sep 04 01:07:35.574426 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 89/170] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:07:35 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1596 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:07:35.578740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:35.579338 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:35.586808 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.587386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.587916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.588739 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.589346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.589873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.798516 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1b8070ec-3fef-47d4-849a-127be01376cd tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "POST /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.304191 Sep 04 01:07:35.800376 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 82/171] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:07:32 2022] POST /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8/os-volume_attachments => generated 194 bytes in 3307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:35.806023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:35.806765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:35.812337 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=98 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:35.814229 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.815500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.816144 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.817341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:35.817966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:35.818537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:35.961561 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5493d108-2ea2-4f99-be5d-02d20f31d7d8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159617 Sep 04 01:07:35.963203 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 83/172] 10.222.0.27 () {60 vars in 1316 bytes} [Sun Sep 4 01:07:35 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:07:36.159500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:36.170033 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3229bdee-9a90-40b3-92b2-b6b54adedef5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.594509 Sep 04 01:07:36.186016 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 90/173] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:35 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:36.554038 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ae8c6a-0583-43a7-b43d-d920ad04325f", "tag": "03ba5432-d158-4dfd-9e61-2dd4ffb23766"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:36.565389 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:36.566342 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:36.566980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:36.593045 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] Creating event network-changed:03ba5432-d158-4dfd-9e61-2dd4ffb23766 for instance c3ae8c6a-0583-43a7-b43d-d920ad04325f on hv-cinder-maste Sep 04 01:07:36.600384 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-172ec7a0-8971-4720-9eda-b2f82e0a9399 req-7ac9c120-49de-427e-9417-92672192ea31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050437 Sep 04 01:07:36.602205 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 84/174] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:37.198703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:37.200013 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:37.214873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:37.237711 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:37.241389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:37.244411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:37.245942 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:37.246670 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:37.563092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:37.576045 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83b4ca16-fccc-4d4b-b6aa-5857aa839c7f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.382682 Sep 04 01:07:37.577639 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 91/175] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:37 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:37.638661 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:37.651388 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:37.652054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:37.653231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:37.669168 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] Creating event network-changed:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:07:37.675215 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-69c334a6-f78d-4507-bdc2-1f90c7d49459 req-896d7106-5966-4ddf-9002-9ce412b5d6a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042182 Sep 04 01:07:37.676169 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 85/176] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:38.601050 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:38.602180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:38.608387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:38.608949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:38.609388 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:38.610081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:38.610582 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:38.611021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:38.754574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:38.765632 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-10f3a3a7-596e-4032-84fa-3c1aec24402f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.168358 Sep 04 01:07:38.766209 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 92/177] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:38 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:39.790806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:39.791541 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:39.797798 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:39.798284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:39.798709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:39.799706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:39.800078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:39.800531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:39.941108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:39.948692 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ed4cc0a0-d0ec-458f-977b-69e5836ff4cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.162689 Sep 04 01:07:39.949293 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 86/178] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:39 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:40.718218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:40.718801 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:40.725967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:40.726460 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:40.727251 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:40.727944 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:40.728700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:40.729130 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:40.758439 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:07:40.973806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:40.974425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:40.981045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:40.981538 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:40.981992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:40.982775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:40.983243 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:40.983668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:41.060675 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa0658dc-72b2-4742-8d01-f4cd7e76b52c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 204 len: 0 microversion: 2.1 time: 0.346492 Sep 04 01:07:41.061257 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:07:40 2022] DELETE /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:07:41.070009 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:41.070865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:41.077528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:41.078340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:41.081136 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:41.082025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:41.082419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:41.082863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:41.136086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:41.144734 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5798f365-0b1d-4784-8fe3-c1db2b4181db tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.175285 Sep 04 01:07:41.145367 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 87/180] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:40 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:41.239374 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:41.247788 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-895216c1-740f-41fa-ac01-83f9c08f0b8f tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1554 microversion: 2.1 time: 0.182007 Sep 04 01:07:41.248320 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 94/181] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:41 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:42.174138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:42.176256 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:42.205986 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:42.205986 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:42.205986 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:42.205986 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:42.206439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:42.206439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:42.271778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:42.272941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:42.278890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:42.279377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:42.279837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:42.280568 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:42.281023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:42.281447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:42.408145 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:42.416893 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:42.421508 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e7edc4af-2b71-460a-9d11-596cf64a99e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.253153 Sep 04 01:07:42.422441 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 88/182] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:42 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:42.435348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:42.443937 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8805d572-241e-42d1-9187-ee4399583104 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1554 microversion: 2.1 time: 0.176589 Sep 04 01:07:42.444537 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 95/183] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:42 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:43.445912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:43.446668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:43.454142 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:43.454736 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:43.455239 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:43.456039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:43.456732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:43.457350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:43.470266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:43.472342 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:43.482335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:43.482829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:43.483460 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:43.484156 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:43.484816 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:43.485442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:43.667022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:43.680613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:43.684210 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28f1ef7d-7c32-4e5c-acad-dfad19fa9e99 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1554 microversion: 2.1 time: 0.220762 Sep 04 01:07:43.685697 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 96/184] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:43 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:43.689766 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4c994c77-487f-4e29-9121-5f23deccdfdd tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.248382 Sep 04 01:07:43.690342 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 89/185] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:43 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:44.536204 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65105ce3-9ff8-4e32-909a-3068131ae3c8", "name": "network-vif-deleted", "tag": "71a78a3b-1fca-47fc-964a-818c95e4c544"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:44.547494 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:44.547989 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:44.548504 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:44.560836 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] Creating event network-vif-deleted:71a78a3b-1fca-47fc-964a-818c95e4c544 for instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 on hv-cinder-maste Sep 04 01:07:44.567191 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c6b8404b-208d-42cd-acf2-8ab69d076d71 req-57114fbe-48d3-4375-a2b4-7afd5be38ccf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Sep 04 01:07:44.568588 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 97/186] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:07:44.710543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:44.711154 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:44.716262 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:44.717070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:44.719211 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:44.719766 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:44.720679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:44.722299 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:44.722901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:44.723457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:44.725017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:44.725581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:44.726350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:44.727387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:44.727900 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:44.728404 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:44.797537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:44.807073 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-097c8ad2-3cff-4478-9910-7e00af77e7b0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1346 microversion: 2.1 time: 0.102898 Sep 04 01:07:44.807648 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 90/187] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:44 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:44.893278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:44.901593 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea3409a7-f2d6-41fe-b9b7-46a1868ab2b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.189672 Sep 04 01:07:44.902179 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 98/188] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:44 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:45.829924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:45.831159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:45.838796 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:45.839274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:45.839905 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:45.840640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:45.841104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:45.841558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:45.878415 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:45.878888 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:45.879316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:45.879832 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lazy-loading 'fault' on Instance uuid 65105ce3-9ff8-4e32-909a-3068131ae3c8 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:07:45.926327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:45.927296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:45.934962 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:45.935808 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:45.936103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:45.937010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:45.937544 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:45.937891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28ff717beef47189f1d005fe7f65a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb006051604f59a1ddcf7a8e7145da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:45.938034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:45.947403 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-86300a2d-a9bb-4a66-a0dc-dc344b8a6dcc tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 200 len: 1351 microversion: 2.1 time: 0.121676 Sep 04 01:07:45.947977 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 91/189] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:45 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:46.296506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:46.308949 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e872d6a1-d73c-4864-ae27-5d0097159a3f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.387112 Sep 04 01:07:46.309915 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 99/190] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:45 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:46.971658 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:46.972306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:46.978840 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:46.979441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:46.979910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:46.980616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:46.981082 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:46.981510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:46.995604 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] HTTP exception thrown: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Request method failure captured: Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 HTTP/1.1 Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_ojG_rgGFV8C_MYjwk5LA6a-0-UJNibSmjIGwgKONnUZnLsFoEMtQ35rr0RcmbONYpCaXL9FR_IKX665zI71kJ4brwT0grS_TM0ShrS2QNeUemsnp4flVqcFITSmQC3IyS9UKq5DpnayICgYYH3j1taD3V6E7hLZKQNJ7GwgNuruNw Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:07:47.000447 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3acb006051604f59a1ddcf7a8e7145da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: a28ff717beef47189f1d005fe7f65a10 Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.001886 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '65105ce3-9ff8-4e32-909a-3068131ae3c8'} Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:07:47.003408 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.004813 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.006316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Returning 404 to user: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:07:47.013922 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-af815517-4972-4bdc-93ba-261d56b2d48c tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 404 len: 111 microversion: 2.1 time: 0.046700 Sep 04 01:07:47.015215 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 92/191] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:46 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:07:47.132079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:47.134483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:47.140684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:47.141166 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:47.141605 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:47.142291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:47.143395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:47.143841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:47.157159 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] HTTP exception thrown: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Request method failure captured: Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8/os-volume_attachments HTTP/1.1 Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_ojG_rgGFV8C_MYjwk5LA6a-0-UJNibSmjIGwgKONnUZnLsFoEMtQ35rr0RcmbONYpCaXL9FR_IKX665zI71kJ4brwT0grS_TM0ShrS2QNeUemsnp4flVqcFITSmQC3IyS9UKq5DpnayICgYYH3j1taD3V6E7hLZKQNJ7GwgNuruNw Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:07:47.161736 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3acb006051604f59a1ddcf7a8e7145da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: a28ff717beef47189f1d005fe7f65a10 Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.163088 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'server_id': '65105ce3-9ff8-4e32-909a-3068131ae3c8'} Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:07:47.163969 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:47.165391 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:07:47.166816 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Returning 404 to user: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:07:47.166816 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e94ec2ea-9538-40eb-a87d-871778ec9d91 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035154 Sep 04 01:07:47.166816 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 100/192] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:07:47 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:07:47.332381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:47.333015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:47.339486 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:47.340225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:47.340859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:47.341718 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:47.342541 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:47.343166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:47.529267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:47.537472 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-451838e7-d44f-4acd-afd9-e2e86b21e192 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.209481 Sep 04 01:07:47.538210 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 93/193] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:47 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:48.562753 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:48.563917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:48.567883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:48.568382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:48.571231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.571816 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.572326 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.573122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.573648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.574458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.579783 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.580275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.580749 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.581522 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.582540 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.582963 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.597513 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] HTTP exception thrown: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Request method failure captured: Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 HTTP/1.1 Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_ojG_rgGFV8C_MYjwk5LA6a-0-UJNibSmjIGwgKONnUZnLsFoEMtQ35rr0RcmbONYpCaXL9FR_IKX665zI71kJ4brwT0grS_TM0ShrS2QNeUemsnp4flVqcFITSmQC3IyS9UKq5DpnayICgYYH3j1taD3V6E7hLZKQNJ7GwgNuruNw Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:07:48.599395 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3acb006051604f59a1ddcf7a8e7145da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: a28ff717beef47189f1d005fe7f65a10 Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.603237 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '65105ce3-9ff8-4e32-909a-3068131ae3c8'} Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:07:48.603880 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.604962 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.606916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Returning 404 to user: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:07:48.606916 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-04e4bad5-21a5-4fdd-9af6-6495583550d0 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 404 len: 111 microversion: 2.1 time: 0.041159 Sep 04 01:07:48.606916 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 94/194] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:07:48 2022] DELETE /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:07:48.610793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:48.611398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] [instance: 65105ce3-9ff8-4e32-909a-3068131ae3c8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:48.617494 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.618006 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.618403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.619102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:48.619552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:48.620554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:48.636763 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] HTTP exception thrown: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Request method failure captured: Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 HTTP/1.1 Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_ojG_rgGFV8C_MYjwk5LA6a-0-UJNibSmjIGwgKONnUZnLsFoEMtQ35rr0RcmbONYpCaXL9FR_IKX665zI71kJ4brwT0grS_TM0ShrS2QNeUemsnp4flVqcFITSmQC3IyS9UKq5DpnayICgYYH3j1taD3V6E7hLZKQNJ7GwgNuruNw Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:07:48.641500 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3acb006051604f59a1ddcf7a8e7145da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3acb006051604f59a1ddcf7a8e7145da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 3acb006051604f59a1ddcf7a8e7145da Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-DeleteServersTestJSON-950453850 Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: a28ff717beef47189f1d005fe7f65a10 Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-DeleteServersTestJSON-950453850-project Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.647078 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '65105ce3-9ff8-4e32-909a-3068131ae3c8'} Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:07:48.647928 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. Sep 04 01:07:48.654998 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:07:48.656710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] Returning 404 to user: Instance 65105ce3-9ff8-4e32-909a-3068131ae3c8 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:07:48.656710 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f35c6170-5a2a-4e23-af47-5ed71070e548 tempest-DeleteServersTestJSON-950453850 tempest-DeleteServersTestJSON-950453850-project] 10.222.0.27 "GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8" status: 404 len: 111 microversion: 2.1 time: 0.035924 Sep 04 01:07:48.656710 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 95/195] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:48 2022] GET /compute/v2.1/servers/65105ce3-9ff8-4e32-909a-3068131ae3c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:07:48.790492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:48.799385 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89d55158-f856-42ee-89e6-03c0b3e112ac tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.240435 Sep 04 01:07:48.800189 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 101/196] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:48 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:49.829501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:49.829501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:49.831368 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:49.832660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:49.833112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:49.833825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:49.834288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:49.834756 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:50.096588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:50.107990 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-704fd53b-b679-4fcc-8a4e-ad8a443bddca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.287472 Sep 04 01:07:50.120732 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:49 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:51.140237 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:51.141780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:51.149166 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:51.149655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:51.150358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:51.151307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:51.151766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:51.152193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:51.493250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:51.496998 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:07:51.502693 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e2aded9-904c-4274-9f43-59489a942e92 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.373865 Sep 04 01:07:51.503877 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 102/198] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:51 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:52.527113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:52.528445 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:52.536378 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:52.537278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:52.537709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:52.538573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:52.539064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:52.539505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:52.776169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:52.791014 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-72ed5b42-6662-48f4-a0b0-262767e291d9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.268092 Sep 04 01:07:52.791626 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 97/199] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:52 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:53.814258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:53.814865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:53.821912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:53.822396 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:53.822831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:53.823514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:53.823963 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:53.824393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:53.988082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:53.995880 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1b6a241-b9a0-4805-805e-faf17b3d69a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.185989 Sep 04 01:07:53.996599 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 103/200] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:53 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:55.019855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:55.020669 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:55.027222 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:55.027619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:55.028052 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:55.028772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:55.029226 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:55.029675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:55.179522 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:55.193623 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-aa4c3755-395a-4999-9c5c-1a37e8c1e8e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.177966 Sep 04 01:07:55.196966 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 98/201] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:55 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:55.593941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1857905023", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "b6dbdfd8-7bc1-4401-9899-caf67c4485ed"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:07:55.648762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] validate_networks() for [('b6dbdfd8-7bc1-4401-9899-caf67c4485ed', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:07:55.998408 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:07:55.998830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:07:55.999329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:07:55.999738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:07:56.000178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:07:56.010846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:56.011272 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:56.011701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:56.012415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:56.013157 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:56.013583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:56.031086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Getting quotas for project 3ece345f5fb34b3cbdb32d2880bf67da. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:07:56.035004 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Getting quotas for user 7a1fc708e8cd4b42baa8a661a625606b and project 3ece345f5fb34b3cbdb32d2880bf67da. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:07:56.046492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:07:56.048773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:07:56.181685 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5dcb8f4-e6fa-4f64-bc27-29beb5c17d64 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713677 Sep 04 01:07:56.182426 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 104/202] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:07:56.194609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-39a1a15f-6eac-4abe-87a6-decdeb16c75a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:56.195283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-39a1a15f-6eac-4abe-87a6-decdeb16c75a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:56.218864 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:56.219555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:56.227067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:56.227854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:56.229068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:56.230062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:56.230730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:56.231454 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:56.277664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-39a1a15f-6eac-4abe-87a6-decdeb16c75a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:56.285485 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-39a1a15f-6eac-4abe-87a6-decdeb16c75a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1214 microversion: 2.1 time: 0.095170 Sep 04 01:07:56.286541 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 99/203] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:56 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:56.416551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:56.416551 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7654b657-9c72-40de-8b32-0a2428d60bd7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.201466 Sep 04 01:07:56.424969 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 105/204] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:56 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:07:57.313165 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:57.313866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:57.343461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:57.343461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:57.343461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:57.343461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:57.343890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:57.343890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:57.385799 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:57.393921 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cbb48dbe-7646-48cf-abba-50cc12f64c9a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1218 microversion: 2.1 time: 0.084602 Sep 04 01:07:57.394489 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 100/205] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:57 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:57.438275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:57.439153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:57.446537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:57.447128 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:57.447636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:57.448404 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:57.448887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:57.449312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:57.589165 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:57.596932 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1409759a-a168-4ffa-bfdb-88eaadcddc66 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.162398 Sep 04 01:07:57.597434 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 106/206] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:57 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:58.455814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:58.455814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:58.461835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:58.462318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:58.462942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:58.463848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:58.464305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:58.464752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:58.555657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae9b0ccd-298f-49c8-9146-0562e74c1765 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b1daf0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:58.556766 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:58.567982 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dace7f3c-b97c-4266-ada2-c3af86b736fa tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1266 microversion: 2.1 time: 0.120646 Sep 04 01:07:58.572892 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 101/207] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:58 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:58.616933 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae9b0ccd-298f-49c8-9146-0562e74c1765 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/aeb69610-5963-47ec-bb80-e0ce4f9a7bff" status: 200 len: 350 microversion: 2.1 time: 0.062383 Sep 04 01:07:58.616933 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 107/208] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:07:58 2022] GET /compute/v2.1/os-volumes/aeb69610-5963-47ec-bb80-e0ce4f9a7bff => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:07:58.623286 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:58.623940 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:58.630776 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:58.631697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:58.632144 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:58.632874 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:58.633739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:58.634176 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:58.820435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:58.831353 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3859e051-8fa3-4ed7-8b4c-887ef275d01d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.212898 Sep 04 01:07:58.835578 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 102/209] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:58 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:59.595183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:59.595822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:59.603070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:59.603659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:59.604096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:59.604809 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:59.605266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:59.605725 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:59.682384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:07:59.689771 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fd75b330-8e88-4ed2-a507-ae62c0e58ff4 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1272 microversion: 2.1 time: 0.098428 Sep 04 01:07:59.690347 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 108/210] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:59 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:07:59.856813 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:07:59.857425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:07:59.863899 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:59.864381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:59.864851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:07:59.865548 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:07:59.866707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:07:59.867146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:00.005901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:00.013732 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-75cd3a36-79e9-4b72-96fb-495bf6d7eee0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.160768 Sep 04 01:08:00.014300 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 103/211] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:07:59 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:00.712608 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:00.713241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:00.715087 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:00.719815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:00.720295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:00.721640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:00.721640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:00.721948 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:00.722373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:00.951153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:00.963857 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-266212b4-c94d-4895-84bd-75b0b38131a7 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.252923 Sep 04 01:08:00.965070 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 109/212] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:00 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:01.037279 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:01.038017 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:01.047705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:01.047705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:01.047705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:01.047705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:01.048059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:01.048059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:01.157692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee0ec24-089b-4d95-b13b-2ebc6f6501b1", "tag": "5a23b3a3-2bb4-410b-84dc-e97472fe0bc9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:01.180892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:01.182063 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:01.182662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:01.183406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:01.196283 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d1f76763-78c4-4c49-91a8-3b933733c6f5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.157952 Sep 04 01:08:01.199692 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] Creating event network-changed:5a23b3a3-2bb4-410b-84dc-e97472fe0bc9 for instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 on hv-cinder-maste Sep 04 01:08:01.205088 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 104/213] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:01 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:01.207575 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1669609c-b035-497d-9f42-935144404a5c req-c3188266-9852-4d86-8ff8-eba66aca8eb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054018 Sep 04 01:08:01.208560 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 110/214] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:01.401842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f15860e3-0a34-4339-8b09-167ef9473929 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24af3af0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:01.452912 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f15860e3-0a34-4339-8b09-167ef9473929 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c0ae4149-14c3-4197-88d5-93ac26c25ae2" status: 200 len: 349 microversion: 2.1 time: 0.054740 Sep 04 01:08:01.453824 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 105/215] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:08:01 2022] GET /compute/v2.1/os-volumes/c0ae4149-14c3-4197-88d5-93ac26c25ae2 => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:01.990478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:01.991238 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:01.998130 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:01.998620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:01.999062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:01.999755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:02.000209 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:02.000671 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:02.215972 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:02.216571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:02.225943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:02.226776 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:02.227461 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:02.228367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:02.229036 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:02.229646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:02.247509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:02.266645 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d7fdcad-5990-4438-a885-69137f7204a9 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.281026 Sep 04 01:08:02.267539 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 111/216] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:01 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:02.383948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:02.392728 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ba97580b-3d90-46eb-837b-8d563f153306 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.181274 Sep 04 01:08:02.393770 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 106/217] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:02 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:03.303793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:03.304863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:03.312853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:03.313395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:03.313908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:03.314674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:03.315126 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:03.315580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:03.417137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:03.417753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:03.424271 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:03.424884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:03.427072 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:03.427072 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:03.427859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:03.428403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:03.447259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:03.455184 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-baa26afb-1ae3-4fc7-aa41-02c2c70d9309 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.158776 Sep 04 01:08:03.460947 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 112/218] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:03 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:03.562718 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:03.570511 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-37ce6ffe-244e-415b-9ca1-54dfacada58f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.157371 Sep 04 01:08:03.571002 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 107/219] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:03 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:04.242591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82b38280-0d6d-4679-99bb-778a7540b40a tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b09700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.293562 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82b38280-0d6d-4679-99bb-778a7540b40a tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/aeb9fcb1-6613-4f74-8e25-1a1e1c17a342" status: 200 len: 351 microversion: 2.1 time: 0.055276 Sep 04 01:08:04.296493 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 113/220] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes/aeb9fcb1-6613-4f74-8e25-1a1e1c17a342 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:04.307345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-70f1466b-7617-4d41-ac6b-5013c5daa4de tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24af3700>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.392895 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-70f1466b-7617-4d41-ac6b-5013c5daa4de tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087836 Sep 04 01:08:04.392895 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 108/221] 10.222.0.27 () {58 vars in 1134 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:04.406832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86650641-5950-4c57-b20e-fe69002222c8 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b09550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.482119 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.482119 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:04.487498 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:04.488439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:04.492861 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86650641-5950-4c57-b20e-fe69002222c8 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089571 Sep 04 01:08:04.493459 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 114/222] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:04.499771 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:04.501737 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:04.502723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:04.503137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:04.507667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c01fddbe-d50c-4685-b04f-d7c59ee1aba2 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24c181f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.607164 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c01fddbe-d50c-4685-b04f-d7c59ee1aba2 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.103767 Sep 04 01:08:04.607735 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 115/223] 10.222.0.27 () {58 vars in 1134 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:04.621034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.623730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:04.627656 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:04.628123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:04.628598 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:04.629274 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:04.630280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:04.630748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:04.648303 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:04.656004 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6c698b1d-bf7e-4d68-baa8-9ca65b192d8f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.181080 Sep 04 01:08:04.668484 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 109/224] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:04.668484 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8fb30960-af0d-4eb7-b488-f6d23e210168 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b615e0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.749966 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8fb30960-af0d-4eb7-b488-f6d23e210168 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.092151 Sep 04 01:08:04.759447 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 110/225] 10.222.0.27 () {58 vars in 1167 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:04.765511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38757e16-080b-4739-bd36-d90ce440b347 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24ddb1f0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.788423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:04.797238 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e27e84c-ffa8-4051-93df-9d8d4ced92b6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.179205 Sep 04 01:08:04.808827 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 116/226] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:04.853572 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-38757e16-080b-4739-bd36-d90ce440b347 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.092284 Sep 04 01:08:04.854150 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 111/227] 10.222.0.27 () {58 vars in 1170 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:04.874948 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5aef575e-decd-4c86-ab9a-31dc2b1f9447 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b1dca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:04.958947 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5aef575e-decd-4c86-ab9a-31dc2b1f9447 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087809 Sep 04 01:08:04.959514 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 117/228] 10.222.0.27 () {58 vars in 1155 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:04.973777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a442cebc-d448-4ded-bebb-040edb9cd59a tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b67a60>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:05.058509 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a442cebc-d448-4ded-bebb-040edb9cd59a tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.089039 Sep 04 01:08:05.059083 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 112/229] 10.222.0.27 () {58 vars in 1188 bytes} [Sun Sep 4 01:08:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:05.074645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da768f45-1659-47f4-8009-8bbc724b5730 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] Calling method '.version_select at 0x7fba24b09430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:05.155528 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da768f45-1659-47f4-8009-8bbc724b5730 tempest-VolumesTestJSON-335728717 tempest-VolumesTestJSON-335728717-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084519 Sep 04 01:08:05.156105 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 118/230] 10.222.0.27 () {58 vars in 1155 bytes} [Sun Sep 4 01:08:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:05.679793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:05.680311 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:05.686266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:05.686751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:05.687192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:05.688012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:05.688485 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:05.688952 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:05.693177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:05.821145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:05.826315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:05.844146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:05.847231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:05.849235 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:05.849979 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:05.850951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:05.851614 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:05.852245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:05.852386 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-07162fd0-8e77-4c96-8006-81d06a8f4b7c tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.177474 Sep 04 01:08:05.854100 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 113/231] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:05 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:06.021016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:06.023449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:06.029660 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55b79f56-17ed-42a3-b653-6c6504698a25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.213752 Sep 04 01:08:06.030237 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 119/232] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:05 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:06.877431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:06.878103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:06.879931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:06.885608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:06.886093 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:06.886539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:06.891155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:06.891155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:06.891155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:07.025607 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:07.033542 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b3d050ab-0010-4a24-b6df-1ab84aff242f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.160424 Sep 04 01:08:07.034135 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 114/233] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:06 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:07.049585 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:07.055613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:07.055613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:07.060346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:07.060847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:07.061281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:07.061948 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:07.062399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:07.062830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:07.194230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:07.201991 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35d5d361-7e32-4eb6-88cf-a3c0b7ecd717 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.153532 Sep 04 01:08:07.202706 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 120/234] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:07 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:08.063547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:08.064173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:08.070804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=58 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:08.072677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:08.073384 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:08.073971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:08.075444 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:08.076097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:08.077616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:08.166095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee0ec24-089b-4d95-b13b-2ebc6f6501b1", "name": "network-vif-plugged", "status": "completed", "tag": "5a23b3a3-2bb4-410b-84dc-e97472fe0bc9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:08.185421 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:08.185938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:08.186438 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:08.216677 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] Creating event network-vif-plugged:5a23b3a3-2bb4-410b-84dc-e97472fe0bc9 for instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 on hv-cinder-maste Sep 04 01:08:08.226414 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9cb6fdf3-94b2-47cd-828a-fe34f38b54dc req-e0c9acb0-ed0e-444d-a902-5ab556a08657 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062731 Sep 04 01:08:08.227015 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 121/235] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:08.240587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:08.241434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:08.248782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:08.249518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:08.250190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:08.251273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:08.251865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:08.252508 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:08.354017 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:08.376960 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b56e9552-c4d9-4647-bae7-40f97484cda8 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.310474 Sep 04 01:08:08.388493 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:08 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:08.465351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:08.474170 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-134b53c5-0fbe-4bd6-b63b-14ffb3e65134 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.246081 Sep 04 01:08:08.474854 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 122/237] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:08 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:09.405672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:09.405672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:09.412367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:09.412885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:09.413321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:09.413987 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:09.414511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:09.414905 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:09.501180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:09.501798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:09.508677 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:09.509174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:09.509616 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:09.510304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:09.510870 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:09.511291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:09.548953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:09.557185 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d6ef3a03-d734-49fe-9bd2-3675b3ab8339 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.156151 Sep 04 01:08:09.557772 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 116/238] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:09 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:09.649953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:09.659447 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ec2d5ac-d021-45cb-b54e-8be38b4d4176 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1521 microversion: 2.1 time: 0.162100 Sep 04 01:08:09.660172 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 123/239] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:09 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:10.581277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:10.582820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:10.589942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.590690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.591198 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:10.592188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.599633 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.599633 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:10.691473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:10.692313 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:10.703392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.704094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.704307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:10.705041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.705472 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.705896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:10.757140 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:10.773783 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-874110a5-80dc-4ee0-ad52-c1d4b0c51e3b tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1314 microversion: 2.1 time: 0.197089 Sep 04 01:08:10.774998 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 117/240] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:10 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:10.871312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:10.871712 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5642813c-fcc0-4627-b7b8-0e0818630b19 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1501 microversion: 2.1 time: 0.184280 Sep 04 01:08:10.872291 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 124/241] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:10 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:10.897654 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:10.898701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:10.904981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.905544 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.906057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:10.906748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:10.907204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:10.907631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:11.056081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:11.064034 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3737c9af-fa88-4b4d-9d59-124f6fa34be1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1516 microversion: 2.1 time: 0.170313 Sep 04 01:08:11.064631 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 118/242] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:10 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:11.771905 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-511300a8-8cfd-4c55-8529-674cd797b279 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Action: 'create', calling method: .version_select at 0x7fba24ab8af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-599789689", "metadata": {"Type": "work"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-511300a8-8cfd-4c55-8529-674cd797b279 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 121 Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:08:11.778547 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-599789689", "metadata": {"Type": "work"}}} Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: Sep 04 01:08:11.780867 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-599789689', 'metadata': {'Type': 'work'}}}} Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi '#$%' Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:11.781790 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 01:08:11.783099 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 01:08:11.784158 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 01:08:11.784158 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.784158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-511300a8-8cfd-4c55-8529-674cd797b279 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:11.784158 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-511300a8-8cfd-4c55-8529-674cd797b279 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136972 Sep 04 01:08:11.784158 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 125/243] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Sep 4 01:08:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:08:11.791353 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c86aebfa-27a3-4ead-9226-a6e87db1c814 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Action: 'create', calling method: .version_select at 0x7fba24c02dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1714504671", "metadata": {"Type": "work"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c86aebfa-27a3-4ead-9226-a6e87db1c814 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 120 Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:08:11.797041 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1714504671", "metadata": {"Type": "work"}}} Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:08:11.798491 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1714504671', 'metadata': {'Type': 'work'}}}} Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise error Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi '0' Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:11.799371 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 01:08:11.800746 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 01:08:11.803219 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 01:08:11.803219 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.803431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:11.803431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:11.804430 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c86aebfa-27a3-4ead-9226-a6e87db1c814 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:11.811322 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c86aebfa-27a3-4ead-9226-a6e87db1c814 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017780 Sep 04 01:08:11.811322 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 119/244] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Sep 4 01:08:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 04 01:08:11.811522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:11.811522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:11.811522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:11.811522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:11.811787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:11.811787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:11.818929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7734e745-b6f3-4a2b-b19e-6dbad7cea4ff tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Action: 'create', calling method: .version_select at 0x7fba24b61790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1017284838", "metadata": {"Type": "work"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7734e745-b6f3-4a2b-b19e-6dbad7cea4ff tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 119 Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:08:11.825333 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1017284838", "metadata": {"Type": "work"}}} Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:08:11.826866 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1017284838', 'metadata': {'Type': 'work'}}}} Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise error Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi '' Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:11.827846 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 01:08:11.830080 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 01:08:11.831948 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 01:08:11.831948 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.831948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7734e745-b6f3-4a2b-b19e-6dbad7cea4ff tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:11.831948 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7734e745-b6f3-4a2b-b19e-6dbad7cea4ff tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017103 Sep 04 01:08:11.833103 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 120/245] 10.222.0.27 () {60 vars in 1156 bytes} [Sun Sep 4 01:08:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:08:11.844592 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5cb44232-a18d-4792-b295-fc20add8e1a7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Calling method '.version_select at 0x7fba24b61040>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:11.884268 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-5cb44232-a18d-4792-b295-fc20add8e1a7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] HTTP exception thrown: Volume tempest-invalid-457029699 could not be found. Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5cb44232-a18d-4792-b295-fc20add8e1a7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-457029699 HTTP/1.1 Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:08:11.886415 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Volume tempest-invalid-457029699 could not be found. Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'tempest-invalid-457029699'} Sep 04 01:08:11.888175 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-457029699 could not be found. (HTTP 404) (Request-ID: req-876e962c-a1a8-4135-8838-dba6c6910d1a) Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.889017 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:08:11.890186 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-457029699 could not be found. Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:08:11.897195 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-457029699 could not be found. Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-457029699 could not be found. Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5cb44232-a18d-4792-b295-fc20add8e1a7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 404 to user: Volume tempest-invalid-457029699 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5cb44232-a18d-4792-b295-fc20add8e1a7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-457029699" status: 404 len: 98 microversion: 2.1 time: 0.049328 Sep 04 01:08:11.898631 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 121/246] 10.222.0.27 () {58 vars in 1215 bytes} [Sun Sep 4 01:08:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-457029699 => generated 98 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 04 01:08:11.902496 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-75cde90d-b0b8-41f7-a462-a6e5f34633b1 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007199 Sep 04 01:08:11.903118 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 122/247] 10.222.0.27 () {58 vars in 1140 bytes} [Sun Sep 4 01:08:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 04 01:08:11.913741 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7b138b2b-18e5-43c4-92c2-fea2fa85dd41 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004263 Sep 04 01:08:11.914257 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 123/248] 10.222.0.27 () {58 vars in 1137 bytes} [Sun Sep 4 01:08:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 04 01:08:11.922818 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-125ef88f-85f8-43df-b674-cefb76f66840 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Calling method '.version_select at 0x7fba24d4a790>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:11.971846 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-125ef88f-85f8-43df-b674-cefb76f66840 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] HTTP exception thrown: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-125ef88f-85f8-43df-b674-cefb76f66840 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/os-volumes/2b0292fb-66a5-41f9-97d5-1d0e44afd28c HTTP/1.1 Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:08:11.974345 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '2b0292fb-66a5-41f9-97d5-1d0e44afd28c'} Sep 04 01:08:11.975583 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. (HTTP 404) (Request-ID: req-aeb7af60-74b5-466a-b47a-c14675970abb) Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.976308 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 01:08:11.977329 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 01:08:11.978387 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. Sep 04 01:08:11.979395 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:11.982456 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-125ef88f-85f8-43df-b674-cefb76f66840 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 404 to user: Volume 2b0292fb-66a5-41f9-97d5-1d0e44afd28c could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:11.983551 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-125ef88f-85f8-43df-b674-cefb76f66840 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/2b0292fb-66a5-41f9-97d5-1d0e44afd28c" status: 404 len: 109 microversion: 2.1 time: 0.064393 Sep 04 01:08:11.985848 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 124/249] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:08:11 2022] DELETE /compute/v2.1/os-volumes/2b0292fb-66a5-41f9-97d5-1d0e44afd28c => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:08:11.994517 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5414fea6-d9ca-4835-9bcf-0483da6bfed7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Calling method '.version_select at 0x7fba24b15a60>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:12.008181 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:12.017935 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-969d8ff0-0f24-49af-81a3-95bc3b3aefa1 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1497 microversion: 2.1 time: 0.224421 Sep 04 01:08:12.029228 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 126/250] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:11 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1497 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:12.030937 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-5414fea6-d9ca-4835-9bcf-0483da6bfed7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] HTTP exception thrown: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5414fea6-d9ca-4835-9bcf-0483da6bfed7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Request method failure captured: Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/os-volumes/b59d9047-aa9f-41c9-a01d-f36c53935982 HTTP/1.1 Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_p7Wp_6r4BV7v0bH-6IdPflkh611Ez_mHs2CJl9_PQJ1GaHkHBvTmf6rFmB4Lp_KOQahW6_tQNF3zdJ7zfoINCeYkjr2Dt4jNU55RLlsGgrqNM-LFLPm9wVV1-DF-HyweY1yRSfHB2NmuLbJ004KNvFOHqCXkmXSSikOCvj1Sd5lbM Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:08:12.033105 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d5501935ac8454c9f1f89cd8383c7bb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d5501935ac8454c9f1f89cd8383c7bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 7d5501935ac8454c9f1f89cd8383c7bb Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-525086912 Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9022068567224588b551bba6738e43b1 Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-525086912-project Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'b59d9047-aa9f-41c9-a01d-f36c53935982'} Sep 04 01:08:12.034356 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. (HTTP 404) (Request-ID: req-1c4ca97b-40a4-4a72-b94d-9ac3c949db05) Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:12.035152 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 01:08:12.036907 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 01:08:12.037923 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:08:12.038953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5414fea6-d9ca-4835-9bcf-0483da6bfed7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] Returning 404 to user: Volume b59d9047-aa9f-41c9-a01d-f36c53935982 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:12.039610 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5414fea6-d9ca-4835-9bcf-0483da6bfed7 tempest-VolumesNegativeTest-525086912 tempest-VolumesNegativeTest-525086912-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b59d9047-aa9f-41c9-a01d-f36c53935982" status: 404 len: 109 microversion: 2.1 time: 0.048792 Sep 04 01:08:12.040008 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 125/251] 10.222.0.27 () {58 vars in 1245 bytes} [Sun Sep 4 01:08:11 2022] GET /compute/v2.1/os-volumes/b59d9047-aa9f-41c9-a01d-f36c53935982 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:08:14.165183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:14.171886 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:14.173894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:14.174382 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:14.174809 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:14.175488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:14.176199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:14.176681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:14.210479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'flavor' on Instance uuid f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:08:14.248510 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:14.635687 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-561b6d16-d23d-4329-bd4e-007b2a7ad178 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/action" status: 200 len: 32 microversion: 2.1 time: 0.476965 Sep 04 01:08:14.636902 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 127/252] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:08:14 2022] POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:08:14.649833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:14.650573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:14.657502 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:14.658054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:14.658678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:14.659532 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:14.659986 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:14.661128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:14.812172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:14.821023 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dd8eb29d-fdfe-4da3-bf7d-6d4e791b2172 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.176977 Sep 04 01:08:14.821605 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 126/253] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:14 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:15.845173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:15.845872 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:15.853474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:15.853959 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:15.854397 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:15.855086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:15.855542 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:15.855970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:16.003732 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:16.012419 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d5f91e9-dd11-4804-9d3c-64d826984c8e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.171640 Sep 04 01:08:16.013045 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 128/254] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:15 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:17.035677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:17.036345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:17.042870 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.043432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.043873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.044605 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.045064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.045487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.197723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:17.205469 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4223f89d-1d42-4561-aefa-3cedbe48c779 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.173769 Sep 04 01:08:17.206036 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 127/255] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:17 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:17.414296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:17.414798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:17.420652 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.422818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.422818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.422818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.422818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.423180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.448379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:08:17.796747 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a88437f-faa7-41de-a9c0-f3d4c799739f tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 204 len: 0 microversion: 2.1 time: 0.387386 Sep 04 01:08:17.797347 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 129/256] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:08:17 2022] DELETE /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:08:17.807872 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:17.808519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:17.814655 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.815146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.815586 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.816277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:17.817398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:17.817963 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:17.980587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:17.988395 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-17335ade-c1fc-483f-a103-bc462f33da6a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1503 microversion: 2.1 time: 0.184605 Sep 04 01:08:17.989200 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 128/257] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:17 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:18.230254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:18.231046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:18.237271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:18.237748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:18.238666 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:18.239403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:18.239850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:18.240270 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:18.380785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:18.398929 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f9f8b13-286b-4bfa-8047-51fa0a236e54 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.163018 Sep 04 01:08:18.398929 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 130/258] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:18 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:19.012506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:19.013211 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:19.020401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:19.020934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:19.021793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:19.022509 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:19.023135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:19.025547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:19.174912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:19.184877 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5a8ec6a3-90da-4a8d-a8a8-b5475ffc5832 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1503 microversion: 2.1 time: 0.176414 Sep 04 01:08:19.186569 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 129/259] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:19 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:19.414287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:19.414902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:19.420855 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:19.421337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:19.421779 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:19.422485 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:19.422941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:19.423366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:19.557331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:19.565925 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a4179a7-38bd-4abc-ad35-695cfab7de2c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.155657 Sep 04 01:08:19.566202 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 131/260] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:19 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:20.208603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:20.209684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:20.216071 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:20.216710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:20.217128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:20.218062 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:20.219108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:20.220185 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:20.371087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:20.378924 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-699e0542-e13b-474e-a0c3-3331a2dd0f1a tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1503 microversion: 2.1 time: 0.174542 Sep 04 01:08:20.379726 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 130/261] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:20 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:20.590547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:20.592019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:20.599079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:20.599965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:20.600589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:20.601465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:20.602072 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:20.602775 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:20.773560 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:20.781212 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ea80473-a6af-4653-9005-c46682934745 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.195532 Sep 04 01:08:20.781783 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 132/262] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:20 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:20.901081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee0ec24-089b-4d95-b13b-2ebc6f6501b1", "name": "network-vif-deleted", "tag": "5a23b3a3-2bb4-410b-84dc-e97472fe0bc9"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:20.911048 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:20.911525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:20.911956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:20.924667 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] Creating event network-vif-deleted:5a23b3a3-2bb4-410b-84dc-e97472fe0bc9 for instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 on hv-cinder-maste Sep 04 01:08:20.929979 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-8cab252a-76c7-4e82-b14f-c3abd9ef5e75 req-079698f4-74ae-4b74-915c-02064f6f196f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033316 Sep 04 01:08:20.930765 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 131/263] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:21.403531 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:21.404142 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:21.410235 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:21.411255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:21.411690 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:21.412529 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:21.413047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:21.413476 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:21.451889 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:21.452385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:21.453046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:21.453674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lazy-loading 'fault' on Instance uuid 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:08:21.501450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a1fc708e8cd4b42baa8a661a625606b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ece345f5fb34b3cbdb32d2880bf67da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:21.509203 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ae0caf6-a1c3-400c-afa8-b37dc4c00ac3 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 200 len: 1304 microversion: 2.1 time: 0.109648 Sep 04 01:08:21.509767 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 133/264] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:21 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:21.806598 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:21.807360 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:21.814454 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:21.814934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:21.815548 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:21.816359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:21.817388 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:21.817820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:21.956531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:21.966323 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c4525a0a-a563-4439-9639-cbfb5e281420 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.166755 Sep 04 01:08:21.980968 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 132/265] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:21 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:22.533457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:22.534077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] [instance: 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:22.541612 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:22.542191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:22.549256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:22.549256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:22.549256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:22.549256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:22.559984 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] HTTP exception thrown: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Request method failure captured: Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 HTTP/1.1 Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_poLbeFe-NjZOA2agaKEH3aeS1rBtCSAe5cA8B-XVoC6isbb3ZFsPikIlTZYP5FozR_xEZbukpms5g3vIroYpTPCB2aR0nZEX9-3k35nMRnca79-pJfwIxX4R9n4ttHwa3336kCbXn8-PqYAsx5yklH2H3MIyNcShyijS7ktAJD3VU Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 3ece345f5fb34b3cbdb32d2880bf67da Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesActionsTest-1968431773 Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:08:22.562507 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ece345f5fb34b3cbdb32d2880bf67da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ece345f5fb34b3cbdb32d2880bf67da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ece345f5fb34b3cbdb32d2880bf67da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ece345f5fb34b3cbdb32d2880bf67da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesActionsTest-1968431773 Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 3ece345f5fb34b3cbdb32d2880bf67da Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesActionsTest-1968431773 Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesActionsTest-1968431773-project Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 7a1fc708e8cd4b42baa8a661a625606b Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesActionsTest-1968431773-project Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. Sep 04 01:08:22.563807 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '5ee0ec24-089b-4d95-b13b-2ebc6f6501b1'} Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:22.564517 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. Sep 04 01:08:22.566087 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:22.567118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] Returning 404 to user: Instance 5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:22.567118 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d6fa3fc-92ce-4f9a-8a82-73e7720c4a51 tempest-VolumesActionsTest-1968431773 tempest-VolumesActionsTest-1968431773-project] 10.222.0.27 "GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1" status: 404 len: 111 microversion: 2.1 time: 0.034571 Sep 04 01:08:22.567118 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 134/266] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:22 2022] GET /compute/v2.1/servers/5ee0ec24-089b-4d95-b13b-2ebc6f6501b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:08:22.992159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:22.993385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:23.000773 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:23.001327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:23.001896 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:23.002748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:23.003394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:23.003929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:23.141414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:23.150516 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fe459518-9cd0-44a9-89fa-8461f284110e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.163831 Sep 04 01:08:23.151151 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 133/267] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:22 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:24.176715 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:24.177896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:24.184422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:24.184933 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:24.185361 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:24.186038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:24.186487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:24.186902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:24.362377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:24.371254 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19d04d10-9a0e-46d5-a505-f719f0d668ef tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.198680 Sep 04 01:08:24.371999 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 135/268] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:24 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:25.394149 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:25.394779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:25.401795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:25.402760 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:25.403354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:25.404260 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:25.404918 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:25.405755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:25.563188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:25.571946 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2ebcd0c1-318a-467f-8f73-4a582a69c7c5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.181614 Sep 04 01:08:25.576500 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 134/269] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:25 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:26.595439 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:26.596043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:26.602398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:26.602860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:26.603290 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:26.603962 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:26.604414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:26.604859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:26.745790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:26.754900 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1cd6040d-1ed2-436d-be00-e2c389e4b6cf tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.163148 Sep 04 01:08:26.765859 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 136/270] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:26 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:27.778203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:27.778811 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:27.785569 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:27.786811 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:27.787316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:27.788040 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:27.788514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:27.788940 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:27.922682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:27.930366 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-08f4ebf6-8476-485b-8ae1-54ebb5d6d0ca tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.156241 Sep 04 01:08:27.930972 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 135/271] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:27 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:28.953643 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:28.954329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:28.960757 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:28.961349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:28.961852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:28.962869 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:28.963324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:28.963959 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:29.114884 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:29.131273 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-988b2d99-5d0f-4c78-a806-259fc2e589ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.181373 Sep 04 01:08:29.132941 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 137/272] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:28 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:30.159398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:30.161104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:30.167946 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:30.168439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:30.169058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:30.169607 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:30.170073 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:30.170508 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:30.310766 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:30.319211 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3b96a5c2-c8f2-46e7-b0ae-7306b15399fa tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.165232 Sep 04 01:08:30.319781 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 136/273] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:30 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:31.341444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:31.342080 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:31.348096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:31.348666 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:31.351838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:31.351838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:31.351838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:31.351838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:31.499565 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:31.507617 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e0a0372-00c8-4de7-8892-d7e18e8c35ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.169999 Sep 04 01:08:31.508186 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 138/274] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:31 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:32.537864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:32.538557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:32.545250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.545740 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.546184 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:32.546882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.547342 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.547769 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:32.571256 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:32.696516 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:32.705418 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-951fba86-b957-4734-9aa1-a869b4d4fd2e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1502 microversion: 2.1 time: 0.171910 Sep 04 01:08:32.712630 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 137/275] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:32 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:32.728694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7fea6fd-6f4b-49e4-81c6-27c288c82efb"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:32.730999 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:32.736788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.737275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.737732 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:32.738413 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.738868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.739292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:32.768880 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] HTTP exception thrown: Cannot 'attach_volume' instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 while it is in vm_state rescued Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Request method failure captured: Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/os-volume_attachments HTTP/1.1 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 74 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_ojnIhf8QVAWOLmBUuPtp-OcMLB2jl2xoYk_UXPuLR3073mpe-jTWfPsQtIkzLDhrpisUO28mpJlYeP7jAcWi8NysA4o6BRfz_DYUkt_bPEJtd84G1xFWvwJI5AZbgfBkJ4EnThfaZBq0i8UcgXIxnEJRCO8YpI-Vezoyo08TLG9fE Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:08:32.770460 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dbf47189fc4f3c90eadc4887a831b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 9bef8dc1da4c44dbbafcaf3c813b3262 Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "c7fea6fd-6f4b-49e4-81c6-27c288c82efb"}} Sep 04 01:08:32.772138 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Cannot 'attach_volume' instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 while it is in vm_state rescued Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'server_id': 'f16c63d7-e34c-4215-a9e0-bc69fe40f7d6', 'body': {'volumeAttachment': {'volumeId': 'c7fea6fd-6f4b-49e4-81c6-27c288c82efb'}}} Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:08:32.772974 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 while it is in vm_state rescued Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:08:32.774113 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 while it is in vm_state rescued Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Returning 409 to user: Cannot 'attach_volume' instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 while it is in vm_state rescued {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c2d1931-fef8-471f-90c1-e2d92510d926 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048378 Sep 04 01:08:32.776081 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 139/276] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:08:32 2022] POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 04 01:08:32.781569 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:32.782102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:32.789353 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.789837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.793725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:32.793725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:32.793725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:32.793725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:33.013977 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-eacd4308-e6b5-4469-b469-9e1edf2d6c51 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/action" status: 202 len: 0 microversion: 2.1 time: 0.235956 Sep 04 01:08:33.014641 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 138/277] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:08:32 2022] POST /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:08:33.028613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:33.029268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:33.035500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:33.036035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:33.036518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:33.037216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:33.037803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:33.038267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:33.212094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:33.221457 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74bc9d4a-af9c-4aba-93cb-4695ab0104d5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1510 microversion: 2.1 time: 0.202016 Sep 04 01:08:33.231050 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 140/278] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:33 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:34.247193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:34.247961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:34.254848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:34.256110 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:34.256630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:34.257304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:34.257757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:34.258178 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:34.405573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:34.414610 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-80ab2e89-cb6e-44fb-aa00-eca259ad5c67 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1510 microversion: 2.1 time: 0.172024 Sep 04 01:08:34.415180 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 139/279] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:34 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:35.437922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:35.438946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:35.440731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:35.447108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:35.447602 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:35.448031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:35.448752 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:35.449202 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:35.449955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:35.589859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:35.603615 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dab8be8-3576-49db-a79b-3b67e9c78c8a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1510 microversion: 2.1 time: 0.169490 Sep 04 01:08:35.604414 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 141/280] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:35 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:36.627923 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:36.628700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:36.639685 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:36.640297 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:36.640858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:36.641645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:36.642225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:36.642721 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:37.037084 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:37.045288 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7145fdce-396d-441d-b19e-6756184d4c39 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1510 microversion: 2.1 time: 0.421923 Sep 04 01:08:37.046364 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 140/281] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:36 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:38.070778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:38.071405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:38.077429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:38.077914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:38.078504 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:38.079202 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:38.079660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:38.080088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:38.084989 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:38.256548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:38.266431 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82cdf510-45dc-496d-9edb-9465ba697fd6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1516 microversion: 2.1 time: 0.200923 Sep 04 01:08:38.267088 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 142/282] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:38 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:40.209920 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-bc19f9f0-35e3-4a7c-960e-54dd17299e1c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: .version_select at 0x7fba24b46af0>, body: {"keypair": {"name": "tempest-keypair-7967966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9loUJT2E6yk/fuALyOqG3LgF41Oa8jvqK5mDpJSCauDpPkcPzjKzn+VEY6bUvc5f1KML1Lc3Q61GOukQsN8sZ6fdXtbhQrSCTzCGS/blHDO5VVyBjVQitQI4RY7Qv6/g=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:40.219904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=38 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:40.230562 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-bc19f9f0-35e3-4a7c-960e-54dd17299e1c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:08:40.237451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-bc19f9f0-35e3-4a7c-960e-54dd17299e1c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for user 9bef8dc1da4c44dbbafcaf3c813b3262 and project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:08:40.314286 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-bc19f9f0-35e3-4a7c-960e-54dd17299e1c tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.108877 Sep 04 01:08:40.315156 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 141/283] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:08:40 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:08:43.571351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1316714050", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db02f1f3-e31f-46bf-8240-058198049bb3"}], "security_groups": [{"name": "tempest-securitygroup--1684714361"}], "key_name": "tempest-keypair-7967966", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:43.687827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] validate_networks() for [('db02f1f3-e31f-46bf-8240-058198049bb3', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:08:44.094031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:08:44.094442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:08:44.094905 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:08:44.095499 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:08:44.095904 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:08:44.106078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:44.106552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:44.106981 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:44.107689 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:44.108135 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:44.108583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:44.126083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:08:44.130512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Getting quotas for user 9bef8dc1da4c44dbbafcaf3c813b3262 and project 51dbf47189fc4f3c90eadc4887a831b8. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:08:44.142587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:08:44.144963 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:08:44.299650 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3b53269-8617-4f85-bfd4-ddfb7e441506 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.735570 Sep 04 01:08:44.300652 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 143/284] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:08:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:08:44.314761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-abcaaebf-02ae-4251-bc0c-2813a88c8fff tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:44.315343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-abcaaebf-02ae-4251-bc0c-2813a88c8fff tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:44.405772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-abcaaebf-02ae-4251-bc0c-2813a88c8fff tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:44.413792 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-abcaaebf-02ae-4251-bc0c-2813a88c8fff tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1243 microversion: 2.1 time: 0.104527 Sep 04 01:08:44.414343 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 142/285] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:44 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1243 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:45.438014 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:45.438627 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:45.446061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:45.446821 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:45.447657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:45.448363 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:45.448925 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:45.449355 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:45.518296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:45.527092 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9684976d-b2be-44c3-9432-b54dc09073f0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1247 microversion: 2.1 time: 0.094290 Sep 04 01:08:45.527679 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 144/286] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:45 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:08:46.551942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:46.551942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:46.557219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:46.557694 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:46.558123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:46.558802 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:46.559253 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:46.559673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:46.633803 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:46.641707 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-faca3cca-03b5-4f97-81db-bbbbc5f145f9 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1295 microversion: 2.1 time: 0.095470 Sep 04 01:08:46.642285 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 143/287] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:46 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:47.671138 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:47.671743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:47.678278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:47.678935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:47.679646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:47.680422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:47.680809 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:47.681226 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:47.762153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:47.771166 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1228e428-58fb-4b8e-89f0-82c36bc5ca13 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1301 microversion: 2.1 time: 0.103093 Sep 04 01:08:47.771757 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 145/288] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:47 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:48.582041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-564787282", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "719e1ac8-c018-4261-bec3-4937b21ef767"}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:48.680630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] validate_networks() for [('719e1ac8-c018-4261-bec3-4937b21ef767', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:08:48.794963 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:48.795906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:48.807796 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:48.815972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:48.815972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:48.815972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:48.815972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:48.816331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:49.109950 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:49.110072 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:08:49.110072 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:08:49.110225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:08:49.110527 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:08:49.110935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:08:49.117474 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a809969-b948-42e9-b07a-bfc03881d379 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.326975 Sep 04 01:08:49.118386 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 146/289] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:48 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:49.124644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:49.125338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:49.125996 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:49.127880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:49.129338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:49.130048 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:49.150136 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Getting quotas for project 18076036cce84d48bc9df44f5b563bac. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:08:49.154696 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Getting quotas for user 6ddda0a1a0774b2da6bc75cbb10e094b and project 18076036cce84d48bc9df44f5b563bac. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:08:49.174055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:08:49.174055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:08:49.321643 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:49.324921 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-aaa17fe1-7098-4d70-9a5e-346897148dd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746673 Sep 04 01:08:49.340312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:49.341426 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 144/290] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:08:49.343256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:49.343591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:49.348630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-deda174b-e1e3-49e6-b45a-506680a8cac7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:49.350033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-deda174b-e1e3-49e6-b45a-506680a8cac7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:49.391012 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] Creating event network-changed:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:08:49.409707 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-258121da-42c3-40d7-b807-506b81cbfdc8 req-9376066e-51fe-4ca4-b0e7-3be6cf3886dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093170 Sep 04 01:08:49.410933 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 147/291] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 04 01:08:49.429886 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-deda174b-e1e3-49e6-b45a-506680a8cac7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:49.440143 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-deda174b-e1e3-49e6-b45a-506680a8cac7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1218 microversion: 2.1 time: 0.097263 Sep 04 01:08:49.440971 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:49 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:50.143293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:50.146333 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:50.152778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:50.153267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:50.153758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:50.154450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:50.154905 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:50.156502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:50.474200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0c72b073-566e-4295-ab7d-81d930068925 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:50.474821 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0c72b073-566e-4295-ab7d-81d930068925 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:50.560810 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0c72b073-566e-4295-ab7d-81d930068925 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:50.570093 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0c72b073-566e-4295-ab7d-81d930068925 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1218 microversion: 2.1 time: 0.099838 Sep 04 01:08:50.584577 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 146/293] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:50 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:50.679307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:50.688750 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-256ad8d2-439f-4d62-b75e-8e9c248963e2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.550131 Sep 04 01:08:50.701253 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 148/294] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:50 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:51.594448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:51.595336 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:51.604973 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:51.605498 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:51.605939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:51.606663 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:51.607124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:51.607585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:51.673018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:51.681401 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ab4513ae-f93b-4b54-a9ea-b853adae5c76 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1222 microversion: 2.1 time: 0.091388 Sep 04 01:08:51.681971 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 147/295] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:51 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:51.714562 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:51.715193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:51.722233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:51.722962 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:51.730345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:51.730345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:51.730345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:51.730345 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:51.873312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:51.882184 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c10deccf-9126-480d-84d6-02ce5ee4822b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.171484 Sep 04 01:08:51.882754 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 149/296] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:51 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:52.704431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:52.705256 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:52.712812 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:52.713630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:52.714316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:52.715218 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:52.715935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:52.716358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:52.795750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:52.810517 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8d1113a1-a7ad-44bf-8cf7-26505494e329 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1222 microversion: 2.1 time: 0.110690 Sep 04 01:08:52.818209 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 148/297] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:52 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:52.908291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:52.909607 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:52.916920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:52.917403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:52.918058 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:52.919010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:52.919657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:52.920365 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:53.073932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:53.084658 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db8abe66-1b4d-43ed-ae25-54ded2aa51d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.180222 Sep 04 01:08:53.087670 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:52 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:53.836269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:53.843975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:53.844295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:53.844582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:53.845243 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:53.846104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:53.846859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:53.847431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:53.976619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:53.986713 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-83d3be61-40b3-4213-b6a5-d1f7f0ef806b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1222 microversion: 2.1 time: 0.155450 Sep 04 01:08:53.987510 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 149/299] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:53 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:54.108897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:54.110203 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:54.117041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:54.119649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:54.120149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:54.120699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:54.121305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:54.121752 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:54.126699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:54.138101 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:54.311268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:54.323957 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ce2341a-ccd6-42ca-9596-906ac08016b2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.218474 Sep 04 01:08:54.327515 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 151/300] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:54 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:55.016327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:55.026463 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:55.026806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:55.027817 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:55.030564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:55.031504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:55.031743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:55.032169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:55.101078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:55.108855 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e9b965b4-0e96-47b9-9f72-c4664e889fd1 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1270 microversion: 2.1 time: 0.096461 Sep 04 01:08:55.109970 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 150/301] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:55 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:55.348401 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:55.349257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:55.356788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:55.357408 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:55.357843 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:55.358532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:55.359211 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:55.364634 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:55.661743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:55.675566 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b2bb3a3-ff47-4041-b3a4-41266ebf135f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.331393 Sep 04 01:08:55.680551 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 152/302] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:55 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:56.140086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:56.141310 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:56.152709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:56.153384 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:56.155493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:56.156278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:56.156764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:56.157804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:56.277684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:56.300298 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-98b331d3-b92f-4943-89b4-a8e661a476db tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1276 microversion: 2.1 time: 0.165998 Sep 04 01:08:56.307613 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 151/303] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:56 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:56.710397 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:56.711618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:56.718280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:56.719882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:56.721508 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:56.722504 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:56.723494 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:56.724143 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:56.764268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "name": "network-vif-plugged", "status": "completed", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:56.786526 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:56.787090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:56.787625 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:56.805579 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] Creating event network-vif-plugged:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:08:56.833528 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-f38cb97f-d3a8-42c6-857d-557c2894ae55 req-503a8238-29e7-403c-91a8-b4c89fa478af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074595 Sep 04 01:08:56.834182 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 152/304] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:08:57.125225 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:57.135100 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ced8042c-86f0-4034-99e6-d7692d8a1012 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.431678 Sep 04 01:08:57.137044 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 153/305] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:56 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:57.339573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:57.339573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:57.357165 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:57.358048 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:57.359752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:57.362440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:57.365936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:57.365936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:57.645839 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:57.655878 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c36a219a-65ee-42b3-a6b2-7d96ffafe22b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.326398 Sep 04 01:08:57.656692 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 153/306] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:57 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:58.012961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9afdaa2-1393-478e-a825-7b344fb35827", "tag": "8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:08:58.023809 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:58.027684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:58.027684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:58.039144 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] Creating event network-changed:8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4 for instance c9afdaa2-1393-478e-a825-7b344fb35827 on hv-cinder-maste Sep 04 01:08:58.044804 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-895a84da-0ea4-4860-afdd-3aef56ec6129 req-d2202408-de58-4c16-be28-1a2137f65f4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035828 Sep 04 01:08:58.045547 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 154/307] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:08:58.160582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:58.161193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:58.167054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:58.167533 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:58.169829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:58.169829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:58.169829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:58.169829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:58.452283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:58.462444 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4ebc8b0b-9e0f-4c8e-9534-740f56295041 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.305854 Sep 04 01:08:58.463014 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 154/308] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:58 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:58.682059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:58.682863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:58.689445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:58.690015 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:58.690512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:58.691394 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:58.692648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:58.693150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:58.893180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:58.907776 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd923bfe-f2c6-43ab-a29b-e9f552f3aabc tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.229934 Sep 04 01:08:58.921672 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 155/309] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:58 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:59.484707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:59.485325 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:59.487341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:08:59.493497 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:59.493998 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:59.494429 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:59.495123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:59.495580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:59.496012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:59.711888 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:08:59.721442 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-55ef58d4-0e86-49f2-9113-62358f0892cc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1369 microversion: 2.1 time: 0.240187 Sep 04 01:08:59.723268 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 155/310] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:59 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:08:59.935589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:08:59.936214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:08:59.943803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:59.944838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:59.945365 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:08:59.946123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:08:59.946837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:08:59.947360 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:00.241273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:00.258775 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-351186f1-8d54-4baa-869e-4af647808bd4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.326883 Sep 04 01:09:00.259511 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 156/311] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:08:59 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:00.745066 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:00.745678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:00.748452 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=16 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:00.753492 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:00.754011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:00.761183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:00.761941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:00.762414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:00.763109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:01.079281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:01.100443 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d2a851e1-9240-4a00-8ff9-588dc79721b1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1563 microversion: 2.1 time: 0.354453 Sep 04 01:09:01.101797 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 156/312] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:00 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:01.132373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:01.132985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:01.144018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:01.145505 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:01.146108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:01.146969 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:01.147636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:01.148212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:01.279337 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d483add-a15b-45da-ab31-e9355534a025 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151381 Sep 04 01:09:01.280014 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 157/313] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:09:01 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:01.289808 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:01.290435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:01.317530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:01.318229 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:01.318981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:01.319837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:01.320442 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:01.321064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:01.971053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:01.980481 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4fdb7bb5-9e68-4ea1-ba97-ce7977d51682 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.697577 Sep 04 01:09:01.981151 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 157/314] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:01 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:03.004826 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:03.005439 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:03.011628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:03.012116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:03.012579 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:03.013271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:03.013727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:03.014157 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:03.143282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:03.151570 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a4aed8a-c4eb-46b7-a560-a16499a4d4be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.150812 Sep 04 01:09:03.152138 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 158/315] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:02 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:03.478363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:03.490451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:03.490935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:03.491374 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:03.496006 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:03.504425 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] Creating event network-changed:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:09:03.510368 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-e38667a2-3fec-4591-86ee-516a402ed5ef req-59106386-a3bf-4fa1-b83a-bd21deda81b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Sep 04 01:09:03.511587 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 158/316] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:04.174332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:04.174697 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:04.183030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:04.184173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:04.185066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:04.185919 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:04.186594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:04.187318 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:04.358867 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:04.373422 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-25049452-1212-4357-9121-31cca2b940f0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.199214 Sep 04 01:09:04.373422 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 159/317] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:04 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:05.394280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:05.395416 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:05.405563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:05.406635 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:05.408851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:05.409862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:05.410634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:05.411402 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:05.681216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:05.693812 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c35e8333-5182-485d-8046-d2cacac9da70 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.304562 Sep 04 01:09:05.694391 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 159/318] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:05 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:06.164110 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43e4620e-a03f-4da5-8530-571271984007 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Action: 'create', calling method: .version_select at 0x7fba24be6700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1277331123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMghfAPdIgZyf8HRem3K16CaTVssq8rolCg2oD98MO56NWmacyEUvofTnU+sU+Np7s9Av1jF0IZINMQVIyjG5ykcKBiaQx73l8lyQxETDmuD+90Uz5r9YnZLKkzZPHUOMw=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:06.179061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-43e4620e-a03f-4da5-8530-571271984007 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Getting quotas for project be21c8fcaef64d9dbecf31bd633559c4. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:09:06.182812 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-43e4620e-a03f-4da5-8530-571271984007 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Getting quotas for user 7fee1d5bc3da421fa1c85ea59223fb54 and project be21c8fcaef64d9dbecf31bd633559c4. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:09:06.296096 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43e4620e-a03f-4da5-8530-571271984007 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.295755 Sep 04 01:09:06.296740 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 160/319] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:09:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:06.698938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9afdaa2-1393-478e-a825-7b344fb35827", "name": "network-vif-plugged", "status": "completed", "tag": "8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:06.709268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:06.709743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:06.710166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:06.717521 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:06.718122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:06.724744 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] Creating event network-vif-plugged:8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4 for instance c9afdaa2-1393-478e-a825-7b344fb35827 on hv-cinder-maste Sep 04 01:09:06.725034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:06.725568 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:06.725993 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:06.730762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:06.730762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:06.730762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:06.731021 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-5fa67e6f-c042-45ca-b707-d0ba4139aedc req-d310335a-c39d-470a-a998-7d49db92d086 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Sep 04 01:09:06.731021 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 160/320] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:07.036757 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:07.045999 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e29087e-2484-4805-8282-72dc10e820ac tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.332278 Sep 04 01:09:07.050308 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 161/321] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:06 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:08.070438 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:08.071150 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:08.077881 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:08.078368 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:08.078802 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:08.079496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:08.079947 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:08.080369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:08.222613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:08.232609 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3e03a83f-6555-44ed-9318-10066a39eff0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.167419 Sep 04 01:09:08.233829 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 161/322] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:08 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:09.256669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:09.257827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:09.260018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:09.265110 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:09.265591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:09.266048 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:09.266743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:09.267193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:09.267613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:09.273206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:09.437358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:09.447608 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61a39b26-afe5-4f16-8f1b-1bf8fd0915be tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1318 microversion: 2.1 time: 0.195904 Sep 04 01:09:09.460785 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 162/323] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:09 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:10.471131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:10.471733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:10.480107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:10.480107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:10.480107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:10.480393 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:10.480827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:10.481248 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:10.612644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:10.620796 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-70d3ab32-6f7e-4124-998a-d7a50d5d959b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1508 microversion: 2.1 time: 0.153502 Sep 04 01:09:10.627515 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 162/324] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:10 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:19.060883 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:19.061508 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:19.063543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:19.068068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:19.068668 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:19.074921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:19.074921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:19.074921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:19.074921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:19.094392 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf4aa7e0-6c73-40c5-883b-e80fa88b4f25 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/ips" status: 200 len: 149 microversion: 2.1 time: 0.037340 Sep 04 01:09:19.095257 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 163/325] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:09:19 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:19.971009 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:19.971600 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:19.974046 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:19.978826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:19.979300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:19.979731 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:19.980403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:19.980883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:19.981418 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:20.004237 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-21d341df-4249-49e5-a2e7-abc612037336 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/ips" status: 200 len: 149 microversion: 2.20 time: 0.037080 Sep 04 01:09:20.004806 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 163/326] 10.222.0.27 () {60 vars in 1289 bytes} [Sun Sep 4 01:09:19 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:09:21.812835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80521c6f-b725-4d03-a910-72817c68a637"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:21.815253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:21.822316 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:21.822798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:21.823231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:21.823907 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:21.824359 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:21.824807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:22.593630 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d00b437-0e41-4a81-8618-bb4e272c7e30 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784982 Sep 04 01:09:22.594248 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 164/327] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:09:21 2022] POST /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:23.443668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:23.444259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:23.452345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:23.452861 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:23.453473 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:23.454180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:23.454638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:23.455064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:23.480016 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lazy-loading 'flavor' on Instance uuid 1824238e-f644-41a1-981f-e90d40bbbdfc {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:09:25.919723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24e95d53-d78b-4f98-9a64-6364a51a999d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: .version_select at 0x7fba24bd41f0>, body: {"keypair": {"name": "tempest-keypair-628262437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxax76CezqmJi8KYrvlMVg3ZAFhQ63NRBHFvfwqwxrfeJpwLnvHRB7TURo2nzV8vc90Gc/Y0LHjm6rVdQmYWYZ+bFLYQrWnNPij/NyoRcJl3ooCmOFhXPmWj1V6M9V/tQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:25.935416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-24e95d53-d78b-4f98-9a64-6364a51a999d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:09:25.939259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-24e95d53-d78b-4f98-9a64-6364a51a999d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:09:26.019639 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24e95d53-d78b-4f98-9a64-6364a51a999d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105203 Sep 04 01:09:26.020255 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 165/328] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:09:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:09:27.100312 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c2032bd1-e6a5-4392-af01-116c126c1d2b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/action" status: 202 len: 0 microversion: 2.20 time: 3.660751 Sep 04 01:09:27.101105 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 164/329] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Sep 4 01:09:23 2022] POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/action => generated 0 bytes in 3662 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:09:27.109951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:27.115563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:27.117956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:27.118456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:27.118891 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:27.119580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:27.120030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:27.120481 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:27.334930 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:27.343429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:27.344908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:27.346071 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80e37404-0969-427d-a1e9-6245a33081a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.240699 Sep 04 01:09:27.346940 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 166/330] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:27 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:28.299551 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-804983715", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b20c706-eedb-40a9-af04-eb1e93ffe3a6"}], "security_groups": [{"name": "tempest-securitygroup--1943799793"}], "key_name": "tempest-keypair-628262437", "user_data": "}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:28.371742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:28.372428 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:28.379708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:28.380515 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:28.386336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:28.386336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:28.386336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:28.386336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:28.445912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] validate_networks() for [('2b20c706-eedb-40a9-af04-eb1e93ffe3a6', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:09:28.520293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:28.529341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:28.530907 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:28.532127 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-234e1440-6c03-485a-830e-0747dc9aa58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.164730 Sep 04 01:09:28.532691 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 167/331] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:28 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:09:28.823633 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:09:28.824073 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:09:28.824628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:09:28.825063 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:09:28.825471 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:09:28.834027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:28.834503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:28.834935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:28.835682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:28.836135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:28.836593 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:28.854321 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:09:28.858223 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:09:28.869572 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:09:28.871908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:09:28.986925 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f014b4d7-a211-43f3-8672-c73cd814d2da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692772 Sep 04 01:09:28.987568 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 165/332] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:09:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:09:28.999313 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-563dee48-b62a-45b2-bb8f-28e3af8bd6e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:28.999927 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-563dee48-b62a-45b2-bb8f-28e3af8bd6e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:29.054962 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-563dee48-b62a-45b2-bb8f-28e3af8bd6e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:29.062522 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-563dee48-b62a-45b2-bb8f-28e3af8bd6e5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1240 microversion: 2.1 time: 0.067096 Sep 04 01:09:29.063091 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 168/333] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:28 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:29.558292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:29.558908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:29.565089 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:29.565574 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:29.566013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:29.566699 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:29.567153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:29.567586 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:29.702269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:29.710894 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:29.713086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:29.714439 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-31363795-da88-4314-9777-0946d6b7a86d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.160868 Sep 04 01:09:29.714997 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 166/334] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:29 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:30.085694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:30.086331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:30.094007 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:30.094493 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:30.094930 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:30.095619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:30.096079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:30.096536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:30.156592 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:30.165395 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76e81704-d8d2-4253-8ce0-b478a317c7da tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1244 microversion: 2.1 time: 0.083241 Sep 04 01:09:30.166535 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 169/335] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:30 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:30.740655 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:30.741377 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:30.748206 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:30.748727 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:30.749159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:30.749833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:30.750280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:30.750696 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:30.879357 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:30.887752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:30.889247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:30.890404 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-90d7f7ca-31a1-4380-80b7-78ae564370bf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.153604 Sep 04 01:09:30.890973 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 167/336] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:30 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:31.189283 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:31.190014 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:31.196398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:31.197614 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:31.198062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:31.198755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:31.199208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:31.199635 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:31.264601 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:31.272337 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5533e5a8-1f8f-4f6d-8596-fa337a95e1c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1292 microversion: 2.1 time: 0.087091 Sep 04 01:09:31.272954 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 170/337] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:31 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:31.914991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:31.915876 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:31.922148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:31.922623 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:31.923059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:31.923744 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:31.924195 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:31.924661 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:32.053037 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:32.061987 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:32.065003 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:32.065003 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-048b98cd-d4e9-434b-a568-9c3470867116 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.153642 Sep 04 01:09:32.070376 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 168/338] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:31 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:32.295897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:32.296590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:32.303102 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:32.303770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:32.304370 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:32.305241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:32.305844 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:32.307206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:32.566458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:32.574433 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0a4db8d-0379-4181-bcb2-fb29bddc5724 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.282422 Sep 04 01:09:32.575095 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 171/339] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:32 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:33.014663 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011656db-b07f-4e64-a5ac-4d911508a256", "tag": "b5ee77a8-3749-45bb-9ff7-f3aee2e3a521"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:33.024587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:33.025832 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:33.026266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:33.037454 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] Creating event network-changed:b5ee77a8-3749-45bb-9ff7-f3aee2e3a521 for instance 011656db-b07f-4e64-a5ac-4d911508a256 on hv-cinder-maste Sep 04 01:09:33.043205 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-a6017553-3b77-4d55-b2e6-7ca2a9886d36 req-87cbebda-1924-47b0-b768-5155f8da8911 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Sep 04 01:09:33.043824 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 169/340] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:33.091367 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:33.091980 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:33.097819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:33.098304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:33.098742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:33.099428 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:33.099888 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:33.100347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:33.233033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:33.241008 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:33.242434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:33.244094 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc9a4364-f8aa-47bf-97e7-fc31e7803532 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.157000 Sep 04 01:09:33.244799 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 172/341] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:33 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:33.604023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:33.604961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:33.611177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:33.611674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:33.612742 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:33.613440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:33.613897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:33.614327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:33.747382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:33.755100 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2aa9ad39-1599-443e-b5cd-8c1cda1e2ac6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.155823 Sep 04 01:09:33.755669 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 170/342] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:33 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:34.270671 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:34.271280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:34.278254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:34.278732 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:34.279170 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:34.279847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:34.280300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:34.280744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:34.414267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:34.422291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:34.423730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:34.424972 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42d2b54b-8dfc-494f-a5d4-afca2d2abbed tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.158198 Sep 04 01:09:34.425527 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 173/343] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:34 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:34.777567 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:34.778196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:34.784498 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:34.784978 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:34.785409 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:34.786083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:34.786534 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:34.786951 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:34.913334 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:34.921011 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cd8c18b3-eea6-45ae-941f-ca7ee1a3430a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.147428 Sep 04 01:09:34.921575 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 171/344] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:34 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:35.450460 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:35.451044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:35.457109 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:35.457588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:35.458023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:35.463330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:35.463330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:35.463330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:35.589618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:35.598991 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:35.600788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:35.608145 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c5cd1a9-5fa1-4c9b-87df-16485d7a3cb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.155803 Sep 04 01:09:35.608145 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 174/345] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:35 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:35.943612 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:35.944221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:35.950579 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:35.951116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:35.951501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:35.952184 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:35.952675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:35.953103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:35.955724 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:36.083081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:36.090649 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7697c8a0-b39f-4ba3-98dc-a9306acadf6f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.150870 Sep 04 01:09:36.091208 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 172/346] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:35 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:36.627588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:36.628196 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:36.635814 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:36.636300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:36.636769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:36.637456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:36.637912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:36.638339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:36.768822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:36.777751 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:36.779207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:36.780367 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7708e2c3-0b03-42f1-be02-32d31268cf2a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.156672 Sep 04 01:09:36.780962 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 175/347] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:36 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:37.113587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:37.114224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:37.121276 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:37.121762 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:37.122201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:37.122883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:37.123339 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:37.123763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:37.253015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:37.261344 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9edf5c43-ef3a-4018-9d9c-73acc7b580ab tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.151600 Sep 04 01:09:37.261907 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 173/348] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:37 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:37.805797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:37.806423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:37.813267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:37.813755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:37.814201 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:37.814893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:37.815347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:37.815775 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:37.949700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:37.957628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:37.959062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:37.960199 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b968960a-5f56-416e-a197-19efd44a50b5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.158356 Sep 04 01:09:37.960862 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 176/349] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:37 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:38.284020 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:38.284675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:38.291066 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:38.296192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:38.296192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:38.296192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:38.296192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:38.296584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:38.423124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:38.430949 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ebebccc3-9cb6-4238-94b8-c42192c82141 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.150672 Sep 04 01:09:38.434060 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 174/350] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:38 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:38.985903 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:38.986486 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:38.993050 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:38.993555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:38.993997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:38.994800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:38.995285 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:38.995716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:39.060636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:39.127565 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:39.136376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:39.137831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:39.139304 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea9135cc-87a7-4064-af2d-642682ad6d07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.157199 Sep 04 01:09:39.139878 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 177/351] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:38 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:39.455627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:39.456400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:39.458289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:39.458962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:39.464377 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:39.464938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:39.465380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:39.466076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:39.466542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:39.467035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:39.598119 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:39.606268 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-68dea69a-a586-4773-aed6-4f1e755970c4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.154634 Sep 04 01:09:39.616416 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 175/352] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:39 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:40.166297 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:40.166935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:40.174125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.174606 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.175051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.175731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.176183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.176716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.179276 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:40.279569 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1657654119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1277331123", "security_groups": [{"name": "tempest-secgroup-smoke-1657370862"}], "networks": [{"uuid": "f7aa404c-1c4b-45cd-b72e-bc7e43055995"}], "block_device_mapping_v2": [{"uuid": "206da053-5e12-4828-825d-e0184c9c7d12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:40.315468 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:40.325291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:40.326748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:40.328053 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57e2b9ed-b7b2-4833-aca5-81692a864d4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.165930 Sep 04 01:09:40.328446 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 178/353] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:40 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:40.391525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] validate_networks() for [('f7aa404c-1c4b-45cd-b72e-bc7e43055995', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:09:40.629515 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:40.630246 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:40.637147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.637618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.638126 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.638726 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.639175 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.639591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.757182 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:09:40.757713 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:09:40.758116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:09:40.758522 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:09:40.758931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:09:40.768679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.769158 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.769592 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.770507 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:40.770966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:40.771387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:40.776403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:40.785133 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e023bdb-a308-4f31-9316-145337454062 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.159785 Sep 04 01:09:40.785794 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 179/354] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:40 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:40.788257 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Getting quotas for project be21c8fcaef64d9dbecf31bd633559c4. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:09:40.792387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Getting quotas for user 7fee1d5bc3da421fa1c85ea59223fb54 and project be21c8fcaef64d9dbecf31bd633559c4. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:09:40.852571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:09:40.855545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='206da053-5e12-4828-825d-e0184c9c7d12',volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:09:41.231748 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c50cf483-e87c-47e9-bc4e-a2aba3645d39 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.956674 Sep 04 01:09:41.232398 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 176/355] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:09:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:09:41.243546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a38d28db-5fb9-481d-9796-84f6e834396e tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:41.244275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a38d28db-5fb9-481d-9796-84f6e834396e tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:41.301380 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a38d28db-5fb9-481d-9796-84f6e834396e tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:41.308901 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a38d28db-5fb9-481d-9796-84f6e834396e tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1089 microversion: 2.1 time: 0.068524 Sep 04 01:09:41.309511 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 180/356] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:41 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:41.359097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:41.359097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:41.362117 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:41.362613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:41.363091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:41.363781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:41.364232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:41.364682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:41.496031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:41.504746 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:41.506551 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:41.507800 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9e6c659f-0944-4f8a-86a3-f09ce5542217 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.157667 Sep 04 01:09:41.508632 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 177/357] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:41 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:41.807140 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:41.807868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:41.814097 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:41.814578 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:41.815011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:41.815719 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:41.816173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:41.816626 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:41.949218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:41.955149 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c4db98a-6163-4cb7-9004-db5de8118dd8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.151938 Sep 04 01:09:41.956045 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 181/358] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:41 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:42.331088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:42.331709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:42.337904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.338390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.338836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.339531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.339990 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.340421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.400157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:42.409448 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-16734d45-ed08-4e02-9445-ccdf5b9092d4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1139 microversion: 2.1 time: 0.082171 Sep 04 01:09:42.410070 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 178/359] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:42 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:42.533185 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:42.533794 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:42.540184 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.540865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.541306 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.542567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.543373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.543874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.676442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:42.685203 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:42.686636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:42.687777 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed86ce92-6a6f-48ee-a437-379da6bce2cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.158532 Sep 04 01:09:42.688337 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 182/360] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:42 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:42.945408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011656db-b07f-4e64-a5ac-4d911508a256", "name": "network-vif-plugged", "status": "completed", "tag": "b5ee77a8-3749-45bb-9ff7-f3aee2e3a521"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:42.956082 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.956656 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.957089 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.971637 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] Creating event network-vif-plugged:b5ee77a8-3749-45bb-9ff7-f3aee2e3a521 for instance 011656db-b07f-4e64-a5ac-4d911508a256 on hv-cinder-maste Sep 04 01:09:42.977628 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-fb31d6c9-3e7e-470a-847e-5bbb671fac94 req-79f47363-86c4-4fa0-9390-f86703c45382 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Sep 04 01:09:42.977972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:42.978213 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 179/361] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:42.978758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:42.985537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.986025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.986464 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:42.987159 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:42.987621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:42.988083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:43.134606 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:43.143618 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07832f5b-edc1-4944-b468-76abed2e35cc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.169528 Sep 04 01:09:43.144179 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 183/362] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:42 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:43.433771 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:43.434484 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:43.441501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:43.441984 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:43.442424 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:43.443122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:43.443589 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:43.444019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:43.509304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:43.517383 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1df97f7f-8fae-4c45-8ec8-1c1a122bba5d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1187 microversion: 2.1 time: 0.088747 Sep 04 01:09:43.517944 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 180/363] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:43 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:43.713578 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:43.714282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:43.720746 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:43.721231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:43.721673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:43.722361 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:43.722822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:43.723253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:44.078673 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:44.087256 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:44.088742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:44.089903 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6534bbbd-791f-4133-b40d-a4709a0720e7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.380304 Sep 04 01:09:44.090468 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 184/364] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:43 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:44.166534 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:44.167691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:44.174153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:44.174637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:44.175070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:44.175759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:44.176379 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:44.176647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:44.303709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:44.311848 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8fb5c055-53d6-4b89-ab1b-94a4536e7a93 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.149123 Sep 04 01:09:44.312408 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 181/365] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:44 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:44.540145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:44.540821 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:44.547507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:44.548002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:44.548511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:44.549197 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:44.549656 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:44.550086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:44.612441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:44.620702 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59386cf0-d54f-493e-b3b1-494dfd5dbd00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1187 microversion: 2.1 time: 0.084234 Sep 04 01:09:44.621284 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 185/366] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:44 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:45.115605 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:45.116129 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:45.122637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.123116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.123548 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.124235 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.124748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.125172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.263540 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e939bf7a-77ef-40a7-ba8e-359664346da1", "device": "/dev/sdb"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:45.267909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:45.272414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:45.273574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.274204 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.274645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.275338 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.275793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.276252 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.287237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:45.288771 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:45.290090 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5adbc4df-771c-491a-a95a-ffe2c98ac85f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.178681 Sep 04 01:09:45.290870 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 182/367] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:45 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:45.333682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:45.334297 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:45.340920 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.341405 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.341848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.342519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.343193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.343615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.497831 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:45.505467 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e1fb9a3e-9d9e-42c4-ad63-55cd5edac444 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1366 microversion: 2.1 time: 0.175770 Sep 04 01:09:45.508776 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 183/368] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:45 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:45.644374 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:45.645015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:45.650892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.651412 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.651866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.652570 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:45.653023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:45.653446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:45.716150 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:45.724039 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6e74ff0f-5842-43f8-bc4b-b5e85d9674a7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1195 microversion: 2.1 time: 0.083529 Sep 04 01:09:45.724618 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 184/369] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:45 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:46.317349 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:46.318011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:46.328343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.328864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.329300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.330001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.330457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.330884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.699801 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:46.708399 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:46.709977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:46.711426 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e6882555-b947-4173-bae1-03ce8f3006dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.398267 Sep 04 01:09:46.711996 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 185/370] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:46 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:09:46.717414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:46.718224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:46.725513 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.726254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.726874 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.727864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.728534 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.729123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.835181 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de6ad165-f119-4cec-a169-6bba5a707440 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "POST /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.576573 Sep 04 01:09:46.841902 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 186/371] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:09:45 2022] POST /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827/os-volume_attachments => generated 194 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:46.849449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:46.850195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:46.859344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.860610 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.861267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.862178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.863218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.864090 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.877057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:46.896199 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-010d5b65-ed38-4299-952a-f68a8094c321 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1555 microversion: 2.1 time: 0.180032 Sep 04 01:09:46.896199 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 186/372] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:46 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:46.935103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:46.935666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:46.942282 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.942800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.943308 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:46.944186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:46.944836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:46.960531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:47.046432 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3e97c5d3-3bcb-42ec-ad2e-d030b948de74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120337 Sep 04 01:09:47.047027 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 187/373] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:09:46 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:47.051862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "name": "network-vif-plugged", "status": "completed", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:47.079882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:47.080836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:47.081419 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:47.100887 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] Creating event network-vif-plugged:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:09:47.108864 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-b806ed8e-e55a-4f9c-b646-8ed2e2050c5d req-0140ba27-3256-4a22-b7ea-77b931eb40c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060066 Sep 04 01:09:47.110313 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 188/374] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:47.118168 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:47.128653 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a59b8a24-fc11-456f-8589-d3a309f8d831 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1273 microversion: 2.1 time: 0.285204 Sep 04 01:09:47.129552 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 187/375] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:46 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:47.740889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:47.741733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:47.750156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:47.750843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:47.751467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:47.752253 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:47.752977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:47.753553 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:47.953445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:47.965650 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:47.966414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:47.966997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:47.980518 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] Creating event network-changed:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:09:47.986979 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-58b5130f-61b6-4a24-b771-4ac2666b36e2 req-01c1b207-74d1-4bcb-b644-10ee01b59bee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038524 Sep 04 01:09:47.988635 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 188/376] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:09:47.995031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:48.007661 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:48.017628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:48.019323 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5e04d2b0-63ef-4b1a-8555-2f23fbd7e961 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.282841 Sep 04 01:09:48.020043 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 189/377] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:47 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:48.155131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:48.156009 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:48.162041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:48.162519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:48.162953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:48.163638 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:48.164446 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:48.164899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:48.259288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011656db-b07f-4e64-a5ac-4d911508a256", "tag": "b5ee77a8-3749-45bb-9ff7-f3aee2e3a521"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:48.269292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:48.269773 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:48.270207 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:48.282315 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] Creating event network-changed:b5ee77a8-3749-45bb-9ff7-f3aee2e3a521 for instance 011656db-b07f-4e64-a5ac-4d911508a256 on hv-cinder-maste Sep 04 01:09:48.287873 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-1f83bffc-a132-461b-bc53-ba888a2b4fc5 req-2cdf85ac-f244-49f7-a28f-0a9c47b3a751 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Sep 04 01:09:48.288704 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 190/378] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:09:48.317265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:48.325303 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5eb0e675-08ac-408f-9f23-5500ba742b87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.175403 Sep 04 01:09:48.325890 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 189/379] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:48 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:49.051740 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:49.051740 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:49.068381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:49.068816 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:49.069327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:49.072095 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:49.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:49.082333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:49.266389 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:49.268731 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:49.276017 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:49.278268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:49.279463 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7e72ad66-4882-4bd5-8c3c-1140fce3b547 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.238014 Sep 04 01:09:49.280407 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 191/380] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:49 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:49.349243 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:49.351559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:49.352232 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:49.357241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:49.357722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:49.358147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:49.358821 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:49.359269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:49.359688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:49.496076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:49.503698 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5adeca1d-d8b5-43fb-b3a7-2c74dc6a5ed8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.158401 Sep 04 01:09:49.506538 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 190/381] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:49 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:50.305109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:50.305728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:50.313542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:50.314033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:50.314477 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:50.315175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:50.315642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:50.317639 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:50.468738 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:50.480364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:50.483723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:50.486004 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-65980c28-f17a-43a4-96b1-2375131be224 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.183669 Sep 04 01:09:50.486577 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 192/382] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:50 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:50.527369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:50.527912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:50.534914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:50.535394 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:50.535831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:50.536594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:50.537056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:50.537480 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:50.693423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:50.702371 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f392136a-aa52-4aca-9af2-62100769267d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.179199 Sep 04 01:09:50.703587 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 191/383] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:50 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:51.425436 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:51.426195 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:51.478769 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e939bf7a-77ef-40a7-ba8e-359664346da1", "create_info": {"type": "qcow2", "new_file": "volume-e939bf7a-77ef-40a7-ba8e-359664346da1.96ee64d2-c9a9-404b-b36f-79cf9cc22be2.vhdx", "snapshot_id": "96ee64d2-c9a9-404b-b36f-79cf9cc22be2"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:51.487457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=121098) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 04 01:09:51.487994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.488490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.488969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.513611 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:51.514222 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:51.516072 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:51.520749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.521234 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.521672 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.522360 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.522814 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.523329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.529867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.530358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.530890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.554172 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-175ca83b-403b-4d94-b706-4d122e8c71f8 req-5cc3286e-7608-4014-ac54-0f8153465ed4 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.133437 Sep 04 01:09:51.554780 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 193/384] 10.222.0.55 () {64 vars in 1326 bytes} [Sun Sep 4 01:09:51 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:09:51.650195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:51.658322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:51.659759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:51.660941 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a83396ef-6ad0-438c-9bcb-a649a1de7883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.152087 Sep 04 01:09:51.661504 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 192/385] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:51 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:09:51.733193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:51.733901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:51.739881 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.740365 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.740835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.741599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:51.741968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:51.742471 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:51.871572 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:51.879254 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-69771c9d-4af9-48c5-9f2b-932d01452719 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.151313 Sep 04 01:09:51.879827 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 194/386] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:51 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:52.686500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:52.687101 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:52.692961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:52.693439 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:52.693873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:52.694547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:52.694999 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:52.695456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:52.821902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:52.830030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:52.831498 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:52.832677 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a97626f2-e616-4f21-aa94-92ff4a592ca0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1741 microversion: 2.20 time: 0.150389 Sep 04 01:09:52.833278 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 193/387] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:52 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:52.902761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:52.903373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:52.909726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:52.910203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:52.910639 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:52.911320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:52.911776 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:52.912197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:53.044371 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:53.052027 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8693f8c4-cb81-43d8-9dd2-051316f8cce8 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.153661 Sep 04 01:09:53.052621 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 195/388] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:52 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:53.859655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:53.860264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:53.866624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:53.867146 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:53.871899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:53.871899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:53.871899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:53.871899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:54.001261 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:54.009337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:54.011233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:54.012380 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e94882b3-4dde-40dd-9b27-262e90d0a2f5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.156595 Sep 04 01:09:54.012980 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 194/389] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:53 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:54.074673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:54.075213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:54.077622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:54.082314 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:54.082907 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:54.083346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:54.084025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:54.084496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:54.084957 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:54.216004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:54.223739 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f0781892-7798-4722-84e3-39dd17e409ca tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.152964 Sep 04 01:09:54.224304 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 196/390] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:54 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:55.038474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:55.039145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:55.046324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:55.046811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:55.047279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:55.047977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:55.048432 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:55.048883 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:55.053442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:09:55.192536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:55.213240 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:55.216956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:55.218227 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a0f279b-a6dd-4b14-ade3-fce5b761ac9b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.184018 Sep 04 01:09:55.245857 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 195/391] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:55 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:55.249359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:55.250056 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:55.259941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:55.261346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:55.261878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:55.262834 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:55.263465 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:55.263990 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:55.418005 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:55.426221 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f14058cd-c36c-4377-b1f7-485aee0ccfb7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.183175 Sep 04 01:09:55.426878 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 197/392] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:55 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:56.258451 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:56.259302 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:56.266892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:56.267377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:56.267923 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:56.268592 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:56.269044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:56.274186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:56.411419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:56.421131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:56.422793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:56.424262 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-386f0de2-ff06-4c06-b00a-9feb90076720 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.169821 Sep 04 01:09:56.424840 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 196/393] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:56 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:56.451233 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:56.451941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:56.458825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:56.459993 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:56.460565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:56.461337 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:56.461873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:56.462373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:56.597128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:56.607964 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-599823bb-6581-4a7f-8a57-c1144aa821ff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.160747 Sep 04 01:09:56.608814 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 198/394] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:56 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:09:57.450301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:57.451032 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:57.457678 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:57.458158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:57.458624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:57.459335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:57.459835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:57.460190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:57.468939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "name": "network-vif-plugged", "status": "completed", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:09:57.482144 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:57.482632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:57.483065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:57.494893 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] Creating event network-vif-plugged:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:09:57.500644 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-1ae15a9d-b8d3-4af8-bed9-f079a32a6e0e req-149b4b1d-dd57-4b91-a451-119b24a91441 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Sep 04 01:09:57.501821 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 199/395] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:09:57.634067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:57.636627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:57.638698 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:57.649175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:57.649175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:57.649175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:57.649175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:57.649637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:57.649637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:57.651580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:57.653327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:57.659038 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc1dac1a-b604-4ea7-9b3b-c7e0742901ab tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.208336 Sep 04 01:09:57.675070 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 197/396] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:57 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:57.811131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:57.819522 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b28dea62-3b9a-403d-bfeb-8ab78725c1aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.191659 Sep 04 01:09:57.820095 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:57 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:58.698327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:58.699071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:58.705545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:58.706035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:58.706486 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:58.707180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:58.707642 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:58.708059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:58.843770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:58.849880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:58.850135 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:58.851013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:58.851503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:58.851936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:58.852653 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:58.853109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:58.853538 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:58.855810 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:58.857423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:58.858590 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72e22d60-d1b8-4ca1-b195-2b8d5c04c58f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.165446 Sep 04 01:09:58.859159 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 198/398] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:58 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:09:58.990114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:09:59.005752 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-65ccd644-cd0f-4868-845e-fcf07d021c2d tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.166440 Sep 04 01:09:59.006333 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 201/399] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:09:58 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:09:59.884696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:09:59.886516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:09:59.893416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:59.894205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:59.894879 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:09:59.895793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:09:59.896525 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:09:59.897220 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:00.029195 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e939bf7a-77ef-40a7-ba8e-359664346da1", "create_info": {"type": "qcow2", "new_file": "volume-e939bf7a-77ef-40a7-ba8e-359664346da1.78b9a2cf-9ebe-4607-ab25-46aa17350657.vhdx", "snapshot_id": "78b9a2cf-9ebe-4607-ab25-46aa17350657"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:00.033833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:00.034576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:00.035081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:00.042767 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:00.047100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:00.047858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:00.048536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:00.052871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:00.057740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:00.060038 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a1ff029c-48c5-4f43-8e44-9c80c7305883 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.179463 Sep 04 01:10:00.061035 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 199/400] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:09:59 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:00.067306 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:00.067992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:00.075322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:00.076157 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:00.077249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:00.078155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:00.078616 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:00.079044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:00.083013 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-0478d3a6-b1bb-44a4-8ddf-df4fe540ff7e req-9f5ce53d-6384-45fd-8ab9-21a60f82d94a admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.146074 Sep 04 01:10:00.083770 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 202/401] 10.222.0.55 () {64 vars in 1326 bytes} [Sun Sep 4 01:09:59 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:10:00.246416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:00.264158 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d51d8368-17c1-4542-9294-6a80980cab8b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1261 microversion: 2.1 time: 0.198106 Sep 04 01:10:00.265953 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 200/402] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:00 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:01.089462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:01.091030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:01.099739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.100530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.101228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.101919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.102423 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.102848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.244759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:01.253302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:01.254989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:01.256334 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9262f5d3-0ddd-401f-be86-23028acc62cb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.172184 Sep 04 01:10:01.257209 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 203/403] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:01 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:01.287938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:01.288572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:01.295106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.295583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.296011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.296714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.297165 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.297644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.433480 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:01.441479 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cd8fb6b-c77c-4e8e-a93c-64d0a62c2a78 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1445 microversion: 2.1 time: 0.157289 Sep 04 01:10:01.457069 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 201/404] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:01 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:01.467612 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:01.468271 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:01.475219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.475938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.476397 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.477326 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:01.477789 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:01.478216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:01.629768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:01.638629 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6aa83c84-d573-49e9-9fe2-cfe52aa11a28 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1445 microversion: 2.1 time: 0.175292 Sep 04 01:10:01.639239 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 204/405] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:01 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:02.282445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:02.283046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:02.289131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:02.291953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:02.291953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:02.291953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:02.291953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:02.292353 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:02.450226 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:02.459358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:02.475513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:02.475513 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6ef2c97-777c-41cc-9d86-58a29a8fb937 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.193704 Sep 04 01:10:02.475513 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 202/406] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:02 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:03.500028 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:03.501305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:03.515052 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:03.515618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:03.516067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:03.519148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:03.519726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:03.520170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:03.791820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:03.802090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:03.804480 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:03.805388 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8c3fb67b-b51a-4737-83f9-e7c1a571477c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.311387 Sep 04 01:10:03.820962 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 205/407] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:03 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:04.629473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:04.656581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:04.660180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:04.662644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:04.689825 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] Creating event network-changed:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:10:04.703561 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-44b433c8-3e5d-417f-9cf7-408719209323 req-58360d0d-922f-46f3-b976-985702ecff63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078860 Sep 04 01:10:04.704303 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 203/408] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:10:04.832388 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:04.833092 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:04.845252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:04.845745 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:04.851857 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:04.854318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:04.854807 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:04.856280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:05.087131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:05.099151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:05.106228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:05.110636 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-80210832-93d4-4b2c-9468-1c8eb46adf77 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.279622 Sep 04 01:10:05.111444 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 206/409] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:04 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:06.156807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:06.160356 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:06.171856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:06.173054 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:06.173733 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:06.174580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:06.175190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:06.175819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:06.255422 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e939bf7a-77ef-40a7-ba8e-359664346da1", "create_info": {"type": "qcow2", "new_file": "volume-e939bf7a-77ef-40a7-ba8e-359664346da1.66c4e600-f4f0-42e1-bd79-a6ad1ad03a04.vhdx", "snapshot_id": "66c4e600-f4f0-42e1-bd79-a6ad1ad03a04"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:06.259598 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:06.261016 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:06.261732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:06.270181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:06.270916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:06.271516 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:06.289524 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-4f938caf-ab68-48a7-915c-4419d314e5f2 req-68d2c06d-5d60-44d3-87bd-615ddd5e04e9 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.107139 Sep 04 01:10:06.290188 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 207/410] 10.222.0.55 () {64 vars in 1326 bytes} [Sun Sep 4 01:10:06 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 04 01:10:06.358175 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:06.371815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:06.373334 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:06.375117 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-245cab74-a28a-43d7-8d12-5edd0fd47a73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.229598 Sep 04 01:10:06.375691 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 204/411] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:06 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:07.407352 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:07.408075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:07.414384 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:07.414864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:07.415293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:07.415985 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:07.416737 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:07.417173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:07.549075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:07.557291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:07.558849 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:07.560050 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-125708df-0122-4902-925f-156e9e43b120 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.157562 Sep 04 01:10:07.560705 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 208/412] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:07 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:08.585627 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:08.586260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:08.593419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:08.593896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:08.594331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:08.595002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:08.595455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:08.595877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:08.726975 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:08.735672 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:08.737156 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:08.738305 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a98e450-6204-4bf5-b9c6-39b3811fe52c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1736 microversion: 2.20 time: 0.156596 Sep 04 01:10:08.738868 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 205/413] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:08 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:09.763940 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:09.765548 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:09.772666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:09.773155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:09.773594 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:09.774316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:09.774881 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:09.775394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:09.908317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:09.917027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:09.918539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:09.919754 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-de4db68a-c4a2-4bde-939a-cf0c305d0312 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1718 microversion: 2.20 time: 0.160519 Sep 04 01:10:09.920308 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 209/414] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:09 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:10.944744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:10.945289 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:10.952003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:10.952519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:10.952961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:10.953646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:10.954103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:10.954532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:11.084057 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:11.093164 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:11.094620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:11.095779 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16270d9c-01cd-41ab-a3e8-031b5f3d25ad tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1718 microversion: 2.20 time: 0.155200 Sep 04 01:10:11.096346 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 206/415] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:10 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:11.380913 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "name": "network-vif-unplugged", "status": "completed", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:11.392267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:11.392819 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:11.393251 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:11.404408 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] Creating event network-vif-unplugged:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:10:11.409291 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-4be59556-2673-4f3e-970c-5b19258c05b7 req-901e095f-a002-40fb-8666-3f6f2af1e2ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031994 Sep 04 01:10:11.410921 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 210/416] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:10:11.664258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:11.672855 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc3b8d54-b65b-4a03-8b15-ffedafddfc58(cell1) {{(pid=121099) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 04 01:10:11.673301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:11.673764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:11.674186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:11.711893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:11.712361 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:11.712854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:11.736328 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b99ddba0-53e6-4298-a3bc-461d00ec62b5 req-922ae9cc-f34f-447f-aa4f-a8efd7d617c8 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/96ee64d2-c9a9-404b-b36f-79cf9cc22be2?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.96ee64d2-c9a9-404b-b36f-79cf9cc22be2.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.120464 Sep 04 01:10:11.737051 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 207/417] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:10:11 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/96ee64d2-c9a9-404b-b36f-79cf9cc22be2?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.96ee64d2-c9a9-404b-b36f-79cf9cc22be2.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:10:12.121516 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:12.122225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:12.128397 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:12.128917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:12.129403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:12.130050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:12.130538 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:12.130964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:12.261100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:12.263395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:12.269980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:12.271422 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:12.272600 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4dda6233-dfa6-41ae-b57c-6b920a537a22 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1718 microversion: 2.20 time: 0.156095 Sep 04 01:10:12.273164 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 211/418] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:12 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:13.298808 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:13.299490 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:13.305731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:13.306218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:13.306665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:13.307482 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:13.307892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:13.308324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:13.442086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:13.451050 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:13.452524 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:13.453843 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82f9832c-6b0d-4a21-9327-1a81da39361c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1718 microversion: 2.20 time: 0.159989 Sep 04 01:10:13.454418 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 208/419] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:13 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:14.480148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:14.480781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:14.487194 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:14.487619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:14.488053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:14.488761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:14.489217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:14.489646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:14.619649 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:14.627628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:14.629102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:14.630245 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-adf41741-008a-4414-8f6f-eaba2c4912bd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1721 microversion: 2.20 time: 0.155030 Sep 04 01:10:14.630800 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 212/420] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:14 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:14.656006 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aae2319d-9c16-432d-837d-7943c04a7bf5"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:14.658380 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:14.664640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:14.665118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:14.667487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:14.667487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:14.667487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:14.667755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:15.658147 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e7c6821-e5ac-4e63-abfb-b2e63cabfaf4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.005998 Sep 04 01:10:15.658777 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 209/421] 10.222.0.27 () {62 vars in 1364 bytes} [Sun Sep 4 01:10:14 2022] POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments => generated 188 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:10:15.790728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:15.791320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:15.798858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:15.799341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:15.799775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:15.800472 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:15.800943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:15.805903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:15.844725 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121098) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 01:10:16.152647 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b7892c0f-859e-4537-b244-457f06a448f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/action" status: 202 len: 0 microversion: 2.20 time: 0.365574 Sep 04 01:10:16.157373 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 213/422] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Sep 4 01:10:15 2022] POST /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:10:16.163536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:16.163999 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:16.171512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:16.175693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:16.175693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:16.175693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:16.175693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:16.176070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:16.188987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:16.304567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:16.314447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:16.315929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:16.317255 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1bdf00a-9f4d-432b-a344-43cb3320e74c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1747 microversion: 2.20 time: 0.158224 Sep 04 01:10:16.318018 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 210/423] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:16 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:16.907564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:16.958864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:16.962227 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:16.964289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:16.964289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:16.972814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:16.973292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:16.973724 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:16.988226 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-ea2873ce-3d79-41a2-b1d8-7caaef2f9c53 req-78cd7fca-22a6-410b-9df0-b994b6e20acb admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/66c4e600-f4f0-42e1-bd79-a6ad1ad03a04?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.66c4e600-f4f0-42e1-bd79-a6ad1ad03a04.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.081105 Sep 04 01:10:16.988972 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 214/424] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:10:16 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/66c4e600-f4f0-42e1-bd79-a6ad1ad03a04?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.66c4e600-f4f0-42e1-bd79-a6ad1ad03a04.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:10:17.343783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:17.344445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:17.351708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:17.352207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:17.352758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:17.353502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:17.353947 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:17.354368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:17.482909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:17.491483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:17.492981 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:17.494168 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7397b175-78dd-4cec-b7b2-1a40ea93b037 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1747 microversion: 2.20 time: 0.154903 Sep 04 01:10:17.494730 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 211/425] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:17 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:18.521293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:18.521992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:18.529183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:18.529662 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:18.530094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:18.530772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:18.531222 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:18.531644 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:18.661289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:18.670421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:18.671864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:18.673060 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-90513662-b736-4564-92da-f0e0cc2f7f21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1749 microversion: 2.20 time: 0.156533 Sep 04 01:10:18.673619 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 215/426] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:18 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:19.699186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:19.699901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:19.706424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:19.706898 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:19.707402 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:19.708105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:19.708591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:19.709023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:19.841951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:19.852818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:19.854260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:19.855620 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d12caa9f-7ce6-44ed-8277-cb0229e5a6a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1749 microversion: 2.20 time: 0.160910 Sep 04 01:10:19.856379 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 212/427] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:19 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:20.880999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:20.881607 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:20.888943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:20.889421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:20.889850 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:20.890530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:20.891003 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:20.891404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:21.020491 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:21.030352 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:21.031799 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:21.036335 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-36cac1ee-e9a6-4a26-a50b-311dfbea485b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.155796 Sep 04 01:10:21.036335 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 216/428] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:20 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:21.238645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:21.241987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:21.242470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:21.242900 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:21.252373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:21.252674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:21.253039 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:21.267190 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9c678e3c-fca7-49e5-b2bb-b161b4c9c673 req-370d28f5-8c24-4e19-82ac-85cb24a08eb2 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/78b9a2cf-9ebe-4607-ab25-46aa17350657?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.78b9a2cf-9ebe-4607-ab25-46aa17350657.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.084836 Sep 04 01:10:21.267763 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 213/429] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:10:21 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/78b9a2cf-9ebe-4607-ab25-46aa17350657?delete_info=%7B%22file_to_merge%22:%20%22volume-e939bf7a-77ef-40a7-ba8e-359664346da1.78b9a2cf-9ebe-4607-ab25-46aa17350657.vhdx%22,%20%22volume_id%22:%20%22e939bf7a-77ef-40a7-ba8e-359664346da1%22%7D => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:10:22.059284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:22.059923 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:22.066305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:22.066791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:22.067230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:22.067919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:22.068378 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:22.068833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:22.197387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:22.206506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:22.207949 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:22.209132 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fd8fc531-f2f8-4822-864f-349fc0e8bb11 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.154414 Sep 04 01:10:22.209690 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 217/430] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:22 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:23.235282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:23.236082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:23.238031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=46 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:23.242877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:23.243352 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:23.243778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:23.244469 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:23.244929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:23.245647 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:23.380176 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:23.389965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:23.391393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:23.392568 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06b53ee3-33dd-4fab-a65d-c35d620e431f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.162044 Sep 04 01:10:23.393169 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 214/431] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:23 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:24.419014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:24.419938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:24.422325 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:24.427934 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:24.430386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:24.430386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:24.430386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:24.430386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:24.430919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:24.608868 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:24.617897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:24.619434 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:24.620651 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b8923c2f-5b88-47c6-b61f-6c21856430fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.206484 Sep 04 01:10:24.621750 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 218/432] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:24 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:25.202163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:25.202763 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:25.209462 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:25.209944 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:25.210371 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:25.211057 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:25.211505 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:25.211925 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:25.338863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lazy-loading 'services' on Instance uuid c9afdaa2-1393-478e-a825-7b344fb35827 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:10:25.583636 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8424f1c1-8e3d-42a7-8793-f6e95349f2a6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827/os-volume_attachments/e939bf7a-77ef-40a7-ba8e-359664346da1" status: 202 len: 0 microversion: 2.1 time: 0.386025 Sep 04 01:10:25.584239 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 215/433] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:10:25 2022] DELETE /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827/os-volume_attachments/e939bf7a-77ef-40a7-ba8e-359664346da1 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:10:25.650891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:25.651497 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:25.658401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:25.658878 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:25.659309 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:25.659988 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:25.660436 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:25.660879 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:25.786627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:25.795962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:25.797435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:25.798590 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-77bd4780-c206-4fd0-9294-9ac0ad4aee07 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.151541 Sep 04 01:10:25.799144 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 219/434] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:25 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:26.824721 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:26.825495 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:26.833748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:26.834344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:26.834788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:26.835585 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:26.836104 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:26.836659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:26.985698 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:26.994611 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:26.995873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:26.997711 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea243409-b991-4705-9d99-96072b5ea711 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.178171 Sep 04 01:10:26.998273 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 216/435] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:26 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:28.023654 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:28.024366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:28.026689 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:28.031584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:28.032143 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:28.032608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:28.037670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:28.037670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:28.037670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:28.167765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:28.176099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:28.177643 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:28.178879 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f409a65d-1526-4dde-900f-3a4a87b7f0b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.159042 Sep 04 01:10:28.179454 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 220/436] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:28 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:29.205348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:29.205935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:29.212379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:29.212917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:29.213328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:29.214009 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:29.214457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:29.214875 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:29.344736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:29.353158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:29.354643 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:29.355819 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c85e2110-6cea-4bb7-84eb-a51f96698f8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.154431 Sep 04 01:10:29.356672 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 217/437] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:29 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:30.382175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:30.382781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:30.400110 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:30.402354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:30.402354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:30.402354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:30.402354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:30.403422 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:30.535381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:30.544719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:30.546188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:30.547349 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1f694648-288f-456c-9c5b-a01212a1796c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.169220 Sep 04 01:10:30.547919 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 221/438] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:30 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:31.573040 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:31.573693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:31.579693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:31.581990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:31.582476 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:31.582901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:31.583587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:31.584047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:31.584483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:31.714946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:31.723597 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:31.725073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:31.726222 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-feae0c03-8828-49bf-a9ce-c5bf5dc2428d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.157047 Sep 04 01:10:31.726786 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 218/439] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:31 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:32.754452 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:32.755964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:32.765075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:32.765956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:32.766464 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:32.767284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:32.767813 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:32.768506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:32.908104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:32.916560 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:32.917994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:32.919135 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c5e1a3ca-d60e-4b56-9af5-a70f0a017cda tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.170512 Sep 04 01:10:32.919702 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 222/440] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:32 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:33.944269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:33.944935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:33.951576 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:33.952048 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:33.952509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:33.953187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:33.953640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:33.954056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:34.084548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:34.091732 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:34.102108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:34.105545 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9975bae4-3d6e-41ca-81d2-7cff60301bb0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.163310 Sep 04 01:10:34.118753 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 219/441] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:33 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:35.137853 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:35.138481 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:35.145067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:35.145558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:35.145996 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:35.146690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:35.147149 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:35.147579 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:35.280479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:35.289001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:35.290449 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:35.291596 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8d1b4aef-4d7b-40f0-888c-7aa1d539b626 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.158604 Sep 04 01:10:35.292153 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 223/442] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:35 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:36.318045 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:36.318826 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:36.325978 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:36.326594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:36.327254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:36.328214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:36.328717 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:36.329153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:36.468385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:36.476887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:36.484955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:36.484955 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2734694-0772-47f2-84c3-9093f009bfe5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.166801 Sep 04 01:10:36.484955 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 220/443] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:36 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:37.505047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:37.505691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:37.512283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:37.512895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:37.513331 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:37.514022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:37.514478 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:37.514901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:37.651496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:37.661279 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:37.662830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:37.664043 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cd6ccc78-1331-4c4f-80bb-0176c70d6444 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.163011 Sep 04 01:10:37.664622 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 224/444] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:37 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:38.690337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:38.690943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:38.697367 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:38.697846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:38.698278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:38.698953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:38.699405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:38.701026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:38.825938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:38.834358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:38.835788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:38.836955 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ee5f81c-4aa3-428a-9f75-9101de225972 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.150496 Sep 04 01:10:38.837505 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 221/445] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:38 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:39.862869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:39.863463 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:39.869903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:39.870378 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:39.870805 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:39.871493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:39.871944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:39.872447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:40.000964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:40.009613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:40.011058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:40.012341 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-271d115c-122f-4a0b-9be6-8acd047011e2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.153216 Sep 04 01:10:40.012926 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 225/446] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:39 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:41.037665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:41.038280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:41.044806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:41.045781 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:41.046221 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:41.046925 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:41.047421 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:41.047855 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:41.178609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:41.187368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:41.188847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:41.189989 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf25a395-ca12-4ff2-8693-cde28bd3c6aa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.156245 Sep 04 01:10:41.190552 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 222/447] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:41 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:42.216483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:42.217109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:42.225192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:42.225704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:42.226137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:42.226835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:42.227286 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:42.227709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:42.362949 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:42.371626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:42.373094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:42.374238 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-906afd20-45c3-4cac-a316-c179542b77fb tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.162116 Sep 04 01:10:42.374836 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 226/448] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:42 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:43.400482 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:43.401083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:43.407580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:43.408058 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:43.408506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:43.409182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:43.409629 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:43.410075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:43.541430 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:43.550753 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:43.552229 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:43.553417 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b41194c8-4a50-4fe9-9722-91238a19720c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.156798 Sep 04 01:10:43.553992 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 223/449] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:43 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:44.578906 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:44.579529 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:44.586167 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:44.586646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:44.587076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:44.587758 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:44.588233 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:44.588681 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:44.591217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:44.726694 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:44.735183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:44.736673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:44.737818 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-85df6e25-4873-4288-871d-eecb94ed9f32 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.163112 Sep 04 01:10:44.738374 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 227/450] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:44 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:45.763703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:45.764318 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:45.771446 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:45.772322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:45.772977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:45.773898 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:45.774352 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:45.775020 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:45.878498 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:45.879071 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:45.885970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:45.886458 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:45.886892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:45.887580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:45.888033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:45.888480 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:45.915394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:10:45.940441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:45.949130 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:45.950577 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:45.951730 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-592ba4aa-6177-49fd-a1ac-ddfdb6e5ba33 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.192166 Sep 04 01:10:45.952289 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 224/451] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:45 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:46.178746 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8fed12eb-9083-4358-80c6-9494e88b54a4 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 204 len: 0 microversion: 2.1 time: 0.303913 Sep 04 01:10:46.179335 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 228/452] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:10:45 2022] DELETE /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:10:46.187997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:46.188648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:46.194436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:46.194914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:46.195350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:46.196024 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:46.196508 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:46.196936 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:46.331531 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:46.339459 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c33c50fb-fade-46c1-8645-ae770488a280 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.155838 Sep 04 01:10:46.340047 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 225/453] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:46 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:46.978111 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:46.978804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:46.985856 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:46.986328 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:46.986764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:46.987441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:46.987953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:46.988373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:47.116722 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:47.126055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:47.127495 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:47.128675 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b848a98c-7e78-4bed-9fe5-13905fd41129 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.154856 Sep 04 01:10:47.129235 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 229/454] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:46 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:47.366406 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:47.367046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:47.373589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:47.374079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:47.374520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:47.375231 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:47.375715 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:47.376142 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:47.509977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:47.509977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:47.514734 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de997a9b-8a34-4775-987e-970148ebd9e9 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.155357 Sep 04 01:10:47.515326 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 226/455] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:47 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:47.614945 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "name": "network-vif-plugged", "status": "completed", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:47.624203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:47.624800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:47.625226 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:47.636241 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] Creating event network-vif-plugged:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:10:47.641705 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-90a8bc43-7d62-4685-bcf1-06c98196a211 req-a785fad0-07c9-462b-8f62-9f85805692b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 Sep 04 01:10:47.642273 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 230/456] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:10:48.154926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:48.155541 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:48.162161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:48.162648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:48.163151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:48.163832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:48.164287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:48.164743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:48.297502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:48.305838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:48.307263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:48.308398 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e91df79-d57b-4b0b-97b2-f4e263476ee3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.158553 Sep 04 01:10:48.308980 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 227/457] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:48 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:48.538599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:48.539296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:48.545357 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:48.545835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:48.546267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:48.547552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:48.548088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:48.548555 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:48.673573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:48.681175 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-99f42e36-939c-42c2-b23b-9f298c5595a7 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.147176 Sep 04 01:10:48.681735 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 231/458] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:48 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:49.334811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:49.343098 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:49.343098 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.343098 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.343098 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.343531 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.344257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.344720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.472124 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:49.481619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:49.483420 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:49.484897 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0915162a-05ed-4c76-b950-cbe68ebc17af tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.153661 Sep 04 01:10:49.485466 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 228/459] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:49 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:49.649191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a64d6e2-09f5-441e-b44e-030d8e923ac0"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:49.651622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:49.659867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.660350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.660817 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.661501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.661955 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.662380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.704746 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:49.705458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:49.711664 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.712207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.712729 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.713472 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:49.714339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:49.714764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:49.844911 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:49.852647 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a01c3b0-f535-42af-a264-735b586ae28e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.151788 Sep 04 01:10:49.853223 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 229/460] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:49 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:10:50.511922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:50.512625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:50.520424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:50.520424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:50.520713 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:50.521254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:50.522284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:50.522284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:50.667060 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:50.675649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:50.677125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:50.678270 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fae15ba6-b92e-4d60-9e7f-f689cf82ccdf tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.170867 Sep 04 01:10:50.678822 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 230/461] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:50 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:50.878301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:50.878832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:50.885092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:50.885576 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:50.886012 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:50.886694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:50.887151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:50.887580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:51.016621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:51.024384 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fcf3fe9-5793-4c20-a94f-f266de1be326 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.150102 Sep 04 01:10:51.024988 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 231/462] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:50 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:10:51.702833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:51.703762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:51.709988 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:51.710475 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:51.710920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:51.711604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:51.712063 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:51.712521 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:51.842431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:51.851806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:51.853292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:51.856191 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60760d76-97a5-4eab-8947-e5f7c80ef6da tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.155662 Sep 04 01:10:51.856191 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 232/463] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:51 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:52.047749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:52.048385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:52.054575 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:52.055052 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:52.055492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:52.056178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:52.056664 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:52.057093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:52.185465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:52.193419 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bd922bc-d89c-4b75-8b94-0d0835c721c3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1514 microversion: 2.1 time: 0.150211 Sep 04 01:10:52.193986 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 233/464] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:52 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:10:52.743104 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-90a80a56-5a51-4f9c-9244-4cbb8c264601 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.097738 Sep 04 01:10:52.743785 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 232/465] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:10:49 2022] POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments => generated 194 bytes in 3099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:10:52.790095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9afdaa2-1393-478e-a825-7b344fb35827", "name": "network-vif-deleted", "tag": "8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:52.799743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:52.800287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:52.800829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:52.811579 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] Creating event network-vif-deleted:8888e191-a1cf-4c2e-8199-2e2ddb6a8ce4 for instance c9afdaa2-1393-478e-a825-7b344fb35827 on hv-cinder-maste Sep 04 01:10:52.817012 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-37c47742-0822-4a82-bc2b-771f69cc93b7 req-26d00cad-65a1-4dce-bd46-b7ff6a45d9dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030642 Sep 04 01:10:52.817584 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 234/466] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:10:52.880665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:52.881371 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:52.891470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:52.891956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:52.892401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:52.893125 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:52.893580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:52.894008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:53.022346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:53.030830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:53.032278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:53.033515 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0bf42e15-3ea9-4df2-8e54-e6bec9664a0e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.157114 Sep 04 01:10:53.034071 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 233/467] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:52 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:53.218344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:53.219708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:53.226044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:53.227038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:53.227038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:53.227662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:53.228116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:53.228604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:53.293025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:53.301197 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0f19a6f-cb1a-4ec4-a540-b9453f2461ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1303 microversion: 2.1 time: 0.087571 Sep 04 01:10:53.301766 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 235/468] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:53 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:54.059527 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:54.060092 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:54.066605 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:54.067108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:54.067542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:54.068224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:54.068706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:54.069130 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:54.204925 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:54.213542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:54.214931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:54.216092 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-883b8fa8-a13c-4db5-8f4a-f272348d7809 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.160981 Sep 04 01:10:54.216678 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 234/469] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:54 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:54.323059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:54.324201 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:54.326691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=44 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:54.332117 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:54.332772 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:54.333077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:54.333766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:54.334220 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:54.334918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:54.373951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:54.374434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:54.375408 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:54.375863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lazy-loading 'fault' on Instance uuid c9afdaa2-1393-478e-a825-7b344fb35827 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:10:54.418591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:54.426713 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09972fa4-9487-491d-9367-93bfdfca4bb0 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1308 microversion: 2.1 time: 0.107318 Sep 04 01:10:54.427283 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 236/470] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:54 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:55.242552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:55.243166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:55.245904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:10:55.251462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:55.251942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:55.252384 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:55.253099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:55.253557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:55.253982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:55.383446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:55.393449 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:55.394958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:55.396140 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e23fc625-4baa-485e-8c30-42c82290010d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1805 microversion: 2.20 time: 0.157509 Sep 04 01:10:55.396743 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 235/471] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:55 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:10:55.450943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:55.451544 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:55.457941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:55.458420 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:55.458851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:55.459522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:55.459974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:55.460390 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:55.493360 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:55.493846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:55.494277 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:55.494721 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lazy-loading 'fault' on Instance uuid c9afdaa2-1393-478e-a825-7b344fb35827 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:10:55.542038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:55.551837 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e4c594b-a4c7-4bea-9476-59bb9c82f30b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 200 len: 1308 microversion: 2.1 time: 0.104586 Sep 04 01:10:55.555963 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 237/472] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:55 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:56.423612 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:56.427959 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:56.430629 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:56.431107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:56.431539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:56.432219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:56.432706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:56.433141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:56.564900 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:56.573665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:56.575100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:56.575378 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:56.575996 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: c9afdaa2-1393-478e-a825-7b344fb35827] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:56.576501 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-295ba4c6-3e74-4489-9f4e-6df31e6f0e78 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1792 microversion: 2.20 time: 0.157071 Sep 04 01:10:56.577058 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 236/473] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:10:56 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1792 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:10:56.583664 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:56.584447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:56.584912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:56.585618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:56.586075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:56.586508 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:56.601053 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] HTTP exception thrown: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Request method failure captured: Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 HTTP/1.1 Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_qdsTEl1fg4LQYWu_AmwdmYaIK0qFNft5Skn_9QKj_QHO31y7MO3u7cWbHw5wsHaTNPVLHG_sdK3RknKP-PMbWZGr8ZMDn40MnWPgy9sPSEPSdhN9vjCIb3aL9AJw1CElXbidUlgIrgUyKbD00McyeHn31HvLNux8liFta4nFq4OQw Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 18076036cce84d48bc9df44f5b563bac Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:10:56.602737 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18076036cce84d48bc9df44f5b563bac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 18076036cce84d48bc9df44f5b563bac Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotTestJSON-2019146987-project Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 6ddda0a1a0774b2da6bc75cbb10e094b Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotTestJSON-2019146987-project Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. Sep 04 01:10:56.604290 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'c9afdaa2-1393-478e-a825-7b344fb35827'} Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:10:56.605343 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. Sep 04 01:10:56.606774 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:10:56.608516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Returning 404 to user: Instance c9afdaa2-1393-478e-a825-7b344fb35827 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:10:56.608516 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46132784-8ea7-424c-a5f1-249e8c172ed3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827" status: 404 len: 111 microversion: 2.1 time: 0.032689 Sep 04 01:10:56.608516 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 238/474] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:56 2022] GET /compute/v2.1/servers/c9afdaa2-1393-478e-a825-7b344fb35827 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:10:57.119371 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:10:57.121713 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:57.127518 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:57.128007 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:57.128451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:57.129165 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:57.129624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:57.130065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:57.153528 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'flavor' on Instance uuid d25a562c-8571-4621-9cb2-3286e7a64666 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:10:57.429250 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-77b306c6-f6b2-4e33-b389-1def02971b25 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/action" status: 200 len: 32 microversion: 2.1 time: 0.313577 Sep 04 01:10:57.429879 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 237/475] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:10:57 2022] POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:10:57.439570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:57.440300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:57.446339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:57.446819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:57.447252 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:57.447934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:57.448386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:57.448961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:57.608177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:57.617199 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4294ec3-c8df-4e06-b6e5-1df3cad8ac9f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.181697 Sep 04 01:10:57.621407 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 239/476] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:57 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:58.641552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:58.643086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:58.649758 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:58.650244 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:58.650720 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:58.651404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:58.651869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:58.652298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:58.783088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:58.791174 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-68f74e58-3f09-4474-b0a8-2e3d891b3c65 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.153914 Sep 04 01:10:58.791734 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 238/477] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:58 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:10:59.813957 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:10:59.815028 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:10:59.828160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:59.828160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:59.828160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:59.828160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:10:59.828738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:10:59.828738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:10:59.951016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:10:59.960192 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e16b5778-4712-49be-a2b0-00c19dfc1f10 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.150041 Sep 04 01:10:59.960794 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 240/478] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:10:59 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:00.928407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1951685048", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "719e1ac8-c018-4261-bec3-4937b21ef767"}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:00.980015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] validate_networks() for [('719e1ac8-c018-4261-bec3-4937b21ef767', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:11:00.982861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:00.983485 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:00.990548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:00.991042 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:00.991500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:00.992194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:00.992691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:00.993125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:01.124740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:01.132998 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e33c2239-5c2d-4ed1-aa94-5d8a368b8e1a tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.153906 Sep 04 01:11:01.133574 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 241/479] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:00 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:01.322751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:11:01.323108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:11:01.323574 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:11:01.323977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:11:01.324380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:11:01.333594 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:01.334063 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:01.334568 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:01.335310 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:01.335760 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:01.336180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:01.353189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Getting quotas for project 18076036cce84d48bc9df44f5b563bac. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:11:01.357114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Getting quotas for user 6ddda0a1a0774b2da6bc75cbb10e094b and project 18076036cce84d48bc9df44f5b563bac. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:11:01.368174 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:11:01.370502 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:11:01.519472 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-83eba700-0e92-438d-9847-42e00d688453 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595433 Sep 04 01:11:01.520135 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 239/480] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:11:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:11:01.531228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccb05db8-e313-45e3-a372-0425cc44edf2 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:01.531841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccb05db8-e313-45e3-a372-0425cc44edf2 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:01.586725 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ccb05db8-e313-45e3-a372-0425cc44edf2 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:01.593799 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccb05db8-e313-45e3-a372-0425cc44edf2 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1219 microversion: 2.1 time: 0.066360 Sep 04 01:11:01.594372 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 242/481] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:01 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:02.157158 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:02.157903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:02.167700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:02.168174 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:02.168653 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:02.169393 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:02.169848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:02.170277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:02.175086 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:02.299007 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:02.307251 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-eb673c99-ecfa-4f39-b920-a0cb42dc235f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.153991 Sep 04 01:11:02.307825 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:02 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:02.616638 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:02.617249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:02.623531 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:02.624007 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:02.624438 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:02.625140 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:02.625595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:02.626019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:02.688533 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:02.696338 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be0d7cd3-950b-47ce-9306-594e0b5d6312 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1223 microversion: 2.1 time: 0.083565 Sep 04 01:11:02.696932 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 243/483] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:02 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:03.329564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:03.330181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:03.337858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:03.339055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:03.339055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:03.339566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:03.340031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:03.340482 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:03.469691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:03.479280 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b188c1d6-1b0e-410d-a53f-f2f1ea5ca6a2 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.153519 Sep 04 01:11:03.479844 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 241/484] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:03 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:03.718850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:03.719407 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:03.726503 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:03.727010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:03.727440 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:03.728127 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:03.728622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:03.729053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:03.793626 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:03.801852 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de27977e-d713-415c-a9c6-b504c29cce5c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1271 microversion: 2.1 time: 0.087018 Sep 04 01:11:03.802424 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 244/485] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:03 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:04.502965 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:04.503646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:04.510698 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:04.511181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:04.511615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:04.512301 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:04.512785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:04.513207 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:04.644547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:04.652761 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-673a61c8-88a3-45e9-a013-6908d0312efc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.153740 Sep 04 01:11:04.653330 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 242/486] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:04 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:04.825226 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:04.825842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:04.833315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:04.833793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:04.834228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:04.834908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:04.835360 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:04.835783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:04.839758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:05.041386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:05.049405 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af6c1005-0eba-41ff-90d0-282eb698d466 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.228016 Sep 04 01:11:05.050008 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 245/487] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:04 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:05.452597 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742c96f8-ecdf-4be6-aef2-b623a653ae55", "tag": "b9900743-76d1-49ab-8971-909e2f2ba6a6"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:05.462173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:05.462550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:05.462983 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:05.474552 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] Creating event network-changed:b9900743-76d1-49ab-8971-909e2f2ba6a6 for instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 on hv-cinder-maste Sep 04 01:11:05.479278 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-e8a7d44c-4dc8-49a6-89f4-1ab1021903d8 req-a82e9a90-5e65-4ed0-b7cc-bb5db17a40f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030541 Sep 04 01:11:05.479893 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 243/488] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:11:05.676889 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:05.677526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:05.683347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:05.683841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:05.684255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:05.684956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:05.685406 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:05.685825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:05.857023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:05.865546 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e95f458f-9214-480d-b15b-36904ff57b4f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.192800 Sep 04 01:11:05.866121 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:05 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:06.073557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:06.074343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:06.080487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:06.081547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:06.082019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:06.082710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:06.083171 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:06.083598 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:06.220426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:06.229552 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fbc0e75f-eb33-4af2-86bd-a0e21f5156f3 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.160583 Sep 04 01:11:06.230319 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 244/490] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:06 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:06.888422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:06.889029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:06.895786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:06.896253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:06.896727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:06.897401 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:06.897849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:06.898275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:07.031707 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:07.040827 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61d0a554-2f60-49da-b7e1-20a4154ffb12 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.156449 Sep 04 01:11:07.041400 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 247/491] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:06 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:07.252066 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:07.252710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:07.259112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:07.259857 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:07.260297 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:07.261008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:07.261465 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:07.261891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:07.391648 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:07.399954 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cdfab24b-3e00-47ca-948e-d10cd98c43ae tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.151698 Sep 04 01:11:07.400550 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 245/492] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:07 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:08.074016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:08.074623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:08.081199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:08.082000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:08.082471 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:08.083178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:08.083634 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:08.084058 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:08.210971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:08.218978 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71dca763-3f86-451c-bfd4-dc70a9d0902d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.148847 Sep 04 01:11:08.219544 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 248/493] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:08 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:08.423693 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:08.424340 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:08.431393 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:08.431879 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:08.432348 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:08.433069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:08.433589 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:08.433955 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:08.560366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:08.568379 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c11780e9-16d9-4e21-a792-957df6291a85 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.148718 Sep 04 01:11:08.568969 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 246/494] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:08 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:09.243659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:09.245114 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:09.251211 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:09.251695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:09.252136 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:09.252938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:09.253370 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:09.253795 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:09.386182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:09.395815 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adff87fe-d4c9-40b3-938f-5f65f37c5ac5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.156039 Sep 04 01:11:09.396631 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 249/495] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:09 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:09.591451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:09.592041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:09.599255 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:09.599800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:09.600242 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:09.600980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:09.601440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:09.601869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:09.947741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:09.955410 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d7401c97-eb1a-449b-879b-a7b93a2c39e8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.367858 Sep 04 01:11:09.956659 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 247/496] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:09 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:10.419103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:10.419817 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:10.426887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:10.427373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:10.427807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:10.428513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:10.428969 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:10.429392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:10.554842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:10.562961 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6eeecd65-e8a2-4e6b-be8d-f7985f2380f6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.147746 Sep 04 01:11:10.563526 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 250/497] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:10 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:10.978908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:10.979523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:10.985851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:10.986332 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:10.986769 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:10.987578 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:10.988069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:10.988519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:11.114397 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:11.121978 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4ad2bb4c-d170-4ecf-a47e-a27ca218b262 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.146948 Sep 04 01:11:11.122543 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 248/498] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:10 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:11.586042 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:11.586649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:11.591906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:11.593648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:11.594119 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:11.594553 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:11.595225 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:11.595674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:11.596095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:11.725871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:11.733943 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1dfc876-49ff-419b-b8ce-4c6a7941cc7e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.151705 Sep 04 01:11:11.734501 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 251/499] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:11 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:12.061939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742c96f8-ecdf-4be6-aef2-b623a653ae55", "name": "network-vif-plugged", "status": "completed", "tag": "b9900743-76d1-49ab-8971-909e2f2ba6a6"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:12.067188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:12.067866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:12.073532 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:12.074004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:12.074437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:12.085374 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] Creating event network-vif-plugged:b9900743-76d1-49ab-8971-909e2f2ba6a6 for instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 on hv-cinder-maste Sep 04 01:11:12.090480 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-c3ff410d-6215-41d8-8ef7-95cdbabc51ba req-8cc77ca7-df58-4301-b88b-5a0aa78f0947 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Sep 04 01:11:12.091080 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 249/500] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:12.146032 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:12.148002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:12.153112 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:12.153625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:12.154061 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:12.154753 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:12.155208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:12.155633 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:12.287806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:12.295424 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-725aa278-aee4-4afa-8733-669aa85b331b tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.153422 Sep 04 01:11:12.295979 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 252/501] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:12 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:12.758316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:12.759033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:12.766526 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:12.767011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:12.767456 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:12.768146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:12.768645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:12.769187 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:12.896757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:12.904866 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6d64f5eb-1729-4e54-86e1-dfa2c198afec tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1733 microversion: 2.1 time: 0.150842 Sep 04 01:11:12.905436 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 250/502] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:12 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:13.319518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:13.320122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:13.326481 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:13.326952 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:13.327379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:13.328054 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:13.328527 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:13.328944 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:13.458706 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:13.466374 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47b01713-4c43-4a34-80db-034c300d129c tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.151748 Sep 04 01:11:13.466946 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 253/503] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:13 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:13.928711 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:13.929330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:13.935717 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:13.936206 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:13.936711 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:13.937400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:13.937865 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:13.938294 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.064901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:14.073539 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6032cdcd-d019-4bdb-9856-04a65366fd98 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1713 microversion: 2.1 time: 0.148881 Sep 04 01:11:14.074112 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 251/504] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:13 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:14.185222 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:14.185650 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:14.191970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.192446 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.192909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.193567 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.194013 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.194434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.274608 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] HTTP exception thrown: Cannot 'detach_volume' instance d25a562c-8571-4621-9cb2-3286e7a64666 while it is in vm_state rescued Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Request method failure captured: Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments/3a64d6e2-09f5-441e-b44e-030d8e923ac0 HTTP/1.1 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_ojnIhf8QVAWOLmBUuPtp-OcMLB2jl2xoYk_UXPuLR3073mpe-jTWfPsQtIkzLDhrpisUO28mpJlYeP7jAcWi8NysA4o6BRfz_DYUkt_bPEJtd84G1xFWvwJI5AZbgfBkJ4EnThfaZBq0i8UcgXIxnEJRCO8YpI-Vezoyo08TLG9fE Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:11:14.276118 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dbf47189fc4f3c90eadc4887a831b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 9bef8dc1da4c44dbbafcaf3c813b3262 Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:11:14.277475 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Cannot 'detach_volume' instance d25a562c-8571-4621-9cb2-3286e7a64666 while it is in vm_state rescued Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'server_id': 'd25a562c-8571-4621-9cb2-3286e7a64666', 'id': '3a64d6e2-09f5-441e-b44e-030d8e923ac0'} Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d25a562c-8571-4621-9cb2-3286e7a64666 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:11:14.278154 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d25a562c-8571-4621-9cb2-3286e7a64666 while it is in vm_state rescued Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d25a562c-8571-4621-9cb2-3286e7a64666 while it is in vm_state rescued Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:14.279539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Returning 409 to user: Cannot 'detach_volume' instance d25a562c-8571-4621-9cb2-3286e7a64666 while it is in vm_state rescued {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:11:14.280771 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1007839-36f9-4b0d-b2d8-3ec0eb64a2ed tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments/3a64d6e2-09f5-441e-b44e-030d8e923ac0" status: 409 len: 152 microversion: 2.1 time: 0.096426 Sep 04 01:11:14.280771 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 254/505] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:11:14 2022] DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments/3a64d6e2-09f5-441e-b44e-030d8e923ac0 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 04 01:11:14.286866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:14.287398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:14.293204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.293686 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.294124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.294804 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.295260 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.295684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.489649 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:14.490180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:14.496580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.497064 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.497502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.498213 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.498669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.499099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.525622 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-756304cf-af88-4cfc-bdc9-e5089afcb921 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/action" status: 202 len: 0 microversion: 2.1 time: 0.242948 Sep 04 01:11:14.526459 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 252/506] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:11:14 2022] POST /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:11:14.534582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:14.544651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:14.544651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.544651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.544651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.545213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:14.545213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:14.545213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:14.631071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:14.639252 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0104156-4c5b-4b34-9eb0-12812372cb98 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.153637 Sep 04 01:11:14.639823 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 255/507] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:14 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:14.678782 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:14.686854 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d37430df-56cd-4297-8879-7090c1ffd65d tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1721 microversion: 2.1 time: 0.156228 Sep 04 01:11:14.687414 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 253/508] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:14 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:15.662985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:15.663587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:15.670093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:15.670573 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:15.671006 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:15.671686 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:15.672138 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:15.672586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:15.711039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:15.711645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:15.718241 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:15.718798 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:15.719339 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:15.720035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:15.720518 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:15.720943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:15.858233 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:15.867394 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7ebfa094-6e7c-440f-bed1-b653b4c62a95 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1721 microversion: 2.1 time: 0.160097 Sep 04 01:11:15.867986 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 254/509] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:15 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:16.038837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:16.046381 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c3d57b8-c3ef-4b12-aa34-3b044d0cc87f tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1319 microversion: 2.1 time: 0.387918 Sep 04 01:11:16.046976 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 256/510] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:15 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:16.891746 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:16.892288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:16.899211 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:16.899689 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:16.900121 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:16.900826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:16.901278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:16.901703 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:17.031515 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:17.040400 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1386e134-2c4b-4067-a28f-97fbc02614c0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1721 microversion: 2.1 time: 0.152498 Sep 04 01:11:17.041000 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 255/511] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:16 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:17.069580 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:17.070183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:17.076729 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:17.078511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:17.078511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:17.078511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:17.078871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:17.079378 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:17.211362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:17.218881 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a1d7afc5-0e91-4805-8fc4-9b3644483d5a tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1508 microversion: 2.1 time: 0.153310 Sep 04 01:11:17.219443 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 257/512] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:17 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:17.241161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994858df-8167-4334-88e5-385beadd2261", "device": "/dev/sdb"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:17.243978 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:17.249944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:17.250429 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:17.250870 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:17.251555 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:17.252013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:17.252966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:18.063227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:18.063828 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:18.070088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:18.070651 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:18.070981 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:18.071653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:18.072109 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:18.072552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:18.200085 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:18.208427 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1272797f-70dc-4261-9325-3471dedd55b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1721 microversion: 2.1 time: 0.149073 Sep 04 01:11:18.209010 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 258/513] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:18 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:19.231566 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:19.232175 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:19.240266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:19.240851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:19.241210 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:19.241895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:19.242346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:19.243033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:19.328763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:19.373779 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:19.382144 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05c5709e-90ee-4d21-a95b-0dacf2fef1e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1721 microversion: 2.1 time: 0.154859 Sep 04 01:11:19.382707 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 259/514] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:19 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:19.845777 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1e6d448d-b828-4b0d-a7ec-0dd4d34dc60e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "POST /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.608365 Sep 04 01:11:19.847109 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 256/515] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:11:17 2022] POST /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55/os-volume_attachments => generated 194 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:20.406668 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:20.407296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:20.414245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:20.414720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:20.415151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:20.415859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:20.416305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:20.416803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:20.545450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:20.555165 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-597e3b64-2b82-4859-962c-aae4f793ca45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1727 microversion: 2.1 time: 0.152414 Sep 04 01:11:20.555742 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 260/516] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:20 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:20.578627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:20.579218 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:20.586752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:20.587236 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:20.587672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:20.588362 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:20.588851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:20.589277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:20.671601 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d165c864-9ea7-416c-815a-72262c9ed793 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097139 Sep 04 01:11:20.672198 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 257/517] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:11:20 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:21.604009 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:21.614884 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:21.615359 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:21.615783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:21.630185 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] Creating event network-changed:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:11:21.635531 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cf3c8771-bdf5-4358-88de-a625cff78ee8 req-374aca7d-f406-44e4-8737-ace48c6247cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Sep 04 01:11:21.636318 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 261/518] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:23.651151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:23.661249 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:23.661751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:23.662187 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:23.673147 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] Creating event network-changed:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:11:23.678858 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-c508cf34-0f73-4ad0-b8bb-2d7ef72a593a req-2078ceab-d3ec-4faa-a2f3-b0e29ed137b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031378 Sep 04 01:11:23.678996 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 258/519] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:23.944766 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "994858df-8167-4334-88e5-385beadd2261", "create_info": {"type": "qcow2", "new_file": "volume-994858df-8167-4334-88e5-385beadd2261.a39b80bf-5a79-421b-a133-bf658475a5dd.vhdx", "snapshot_id": "a39b80bf-5a79-421b-a133-bf658475a5dd"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:23.947980 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:23.948507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:23.948939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:23.957687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:23.958354 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:23.958890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:23.972278 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d07e9399-4cea-486e-a55e-a02741ee9bbb req-927bc06b-74e8-4bf9-bd49-0500e5f0c7f7 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.079330 Sep 04 01:11:23.973115 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 262/520] 10.222.0.55 () {64 vars in 1326 bytes} [Sun Sep 4 01:11:23 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:11:28.542844 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "994858df-8167-4334-88e5-385beadd2261", "create_info": {"type": "qcow2", "new_file": "volume-994858df-8167-4334-88e5-385beadd2261.4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2.vhdx", "snapshot_id": "4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2"}}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:28.546198 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:28.546677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:28.547108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:28.555732 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:28.556200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:28.556675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:28.570041 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-da6c4b38-7fc4-4541-9d58-27e56728c140 req-a6d7232a-888a-4857-a413-225905c8b9e0 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.077196 Sep 04 01:11:28.570613 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 259/521] 10.222.0.55 () {64 vars in 1326 bytes} [Sun Sep 4 01:11:28 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:11:30.833169 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:30.833756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:30.836418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=58 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:30.841172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:30.847619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:30.847619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:30.847619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:30.847619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:30.847961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:30.847961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:30.866809 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b7784a3-79eb-4b98-b241-826e5fcccc87 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/ips" status: 200 len: 148 microversion: 2.1 time: 0.038542 Sep 04 01:11:30.867365 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 263/522] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:11:30 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:30.880065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80521c6f-b725-4d03-a910-72817c68a637"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:30.883186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:30.885440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:30.890167 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:30.890645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:30.891081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:30.891757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:30.892238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:30.892747 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:31.067916 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: POST /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/os-volume_attachments HTTP/1.1 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 74 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:11:31.070291 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: {"volumeAttachment": {"volumeId": "80521c6f-b725-4d03-a910-72817c68a637"}} Sep 04 01:11:31.071652 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'server_id': '011656db-b07f-4e64-a5ac-4d911508a256', 'body': {'volumeAttachment': {'volumeId': '80521c6f-b725-4d03-a910-72817c68a637'}}} Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:11:31.072409 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:31.074246 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 400 to user: Invalid volume: volume 80521c6f-b725-4d03-a910-72817c68a637 is already attached to instances: c3ae8c6a-0583-43a7-b43d-d920ad04325f {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a2d22ea3-c745-4faf-88df-fb884e5f4dee tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196602 Sep 04 01:11:31.075695 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 260/523] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:11:30 2022] POST /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:11:31.082074 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:31.082573 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:31.089787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:31.089787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:31.090085 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:31.090736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:31.091192 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:31.091619 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:31.116833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:11:31.402216 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e42c1668-5e91-4049-81cb-eee3f18e0269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 204 len: 0 microversion: 2.1 time: 0.324079 Sep 04 01:11:31.402840 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 264/524] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:11:31 2022] DELETE /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:11:31.411543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:31.412154 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:31.419151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:31.419630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:31.420094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:31.420802 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:31.421252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:31.421673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:31.551351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:31.559133 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-646b41c9-02ed-423c-aeb5-59fcbd15ceda tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1679 microversion: 2.1 time: 0.151688 Sep 04 01:11:31.559738 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 261/525] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:31 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:32.411960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:32.415639 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:32.416108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:32.416601 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:32.425401 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:32.425858 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:32.426279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:32.439651 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6f2ead6a-f795-4a1c-bf12-330991d089af req-004f6035-e622-44d7-a585-489edd680779 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078332 Sep 04 01:11:32.440215 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 265/526] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:11:32 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.4eb2ae26-b9ba-448d-94b0-8d5a1ade22d2.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:11:32.581564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:32.582191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:32.589358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:32.589843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:32.590280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:32.590969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:32.591428 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:32.591857 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:32.721360 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:32.730098 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a6e5b3ba-5d00-4655-985a-b11c53b93a0e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1679 microversion: 2.1 time: 0.152435 Sep 04 01:11:32.730656 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 262/527] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:32 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:33.753849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:33.754545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:33.761476 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:33.761952 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:33.762379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:33.763051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:33.763499 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:33.763917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:33.942071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:33.950341 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56b90709-435c-4929-acb0-cc154f9c8269 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1679 microversion: 2.1 time: 0.201044 Sep 04 01:11:33.950913 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 266/528] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:33 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:34.975359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:34.976069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:34.982792 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:34.983309 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:34.983755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:34.985364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:34.986157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:34.986784 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:35.057692 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:35.066736 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e04b7552-2c92-416e-9879-af3b01a5848a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1611 microversion: 2.1 time: 0.096172 Sep 04 01:11:35.067337 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 263/529] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:34 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:35.126950 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011656db-b07f-4e64-a5ac-4d911508a256", "name": "network-vif-deleted", "tag": "b5ee77a8-3749-45bb-9ff7-f3aee2e3a521"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:35.139425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:35.139902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:35.140327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:35.152532 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] Creating event network-vif-deleted:b5ee77a8-3749-45bb-9ff7-f3aee2e3a521 for instance 011656db-b07f-4e64-a5ac-4d911508a256 on hv-cinder-maste Sep 04 01:11:35.157584 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1c45c41b-c3a6-4c8e-999b-e1dbdef4fcad req-c38d3c31-4ac8-4c29-93a2-3d298ca788c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034282 Sep 04 01:11:35.158378 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 267/530] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:36.092231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:36.093073 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:36.100203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:36.104701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:36.104701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:36.104701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:36.104701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:36.105091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:36.152615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:36.153516 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:36.154248 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:36.154759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid 011656db-b07f-4e64-a5ac-4d911508a256 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:11:36.206190 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:36.215135 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-146b52df-8fe1-4bd1-b323-104cdaa47cca tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 200 len: 1330 microversion: 2.1 time: 0.127379 Sep 04 01:11:36.216552 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 264/531] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:36 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:37.240520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:37.241506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:37.247817 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:37.248301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:37.248782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:37.249472 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:37.250292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:37.250410 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:37.265281 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 HTTP/1.1 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:11:37.268195 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:11:37.269779 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '011656db-b07f-4e64-a5ac-4d911508a256'} Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:11:37.270663 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:11:37.272226 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:37.274895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:11:37.274895 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df7d66fd-4a28-4a26-b766-0238ddbc605b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 404 len: 111 microversion: 2.1 time: 0.032594 Sep 04 01:11:37.274895 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 268/532] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:37 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:37.278306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7bde6a56-ad63-4749-b62b-02d1fde45b84 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '.version_select at 0x7fba24a5f670>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:37.282764 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bde6a56-ad63-4749-b62b-02d1fde45b84 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [2d08e1ee-7ca0-47e9-b632-09750fed7ba3] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 04 01:11:37.686718 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:37.690198 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:37.690681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:37.691114 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:37.700064 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:37.700572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:37.701008 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:37.714795 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-97d6b216-ea7c-438e-b3e2-35f1672ebe17 req-a82667ee-fe15-4d76-b4c5-dac9419856c7 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/603e3b35-5319-41b7-bc86-e183765cd7e3?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.603e3b35-5319-41b7-bc86-e183765cd7e3.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077910 Sep 04 01:11:37.715459 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 269/533] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:11:37 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/603e3b35-5319-41b7-bc86-e183765cd7e3?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.603e3b35-5319-41b7-bc86-e183765cd7e3.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:11:38.289964 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bde6a56-ad63-4749-b62b-02d1fde45b84 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [2d08e1ee-7ca0-47e9-b632-09750fed7ba3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44424. Sep 04 01:11:38.362922 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7bde6a56-ad63-4749-b62b-02d1fde45b84 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628262437" status: 202 len: 0 microversion: 2.1 time: 1.088762 Sep 04 01:11:38.363508 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 265/534] 10.222.0.27 () {58 vars in 1218 bytes} [Sun Sep 4 01:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628262437 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:11:39.185805 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:39.186386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:39.192509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:39.192985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:39.193416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:39.194090 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:39.194538 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:39.194958 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:39.280303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'services' on Instance uuid c3ae8c6a-0583-43a7-b43d-d920ad04325f {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:11:39.504109 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88ef304a-db41-4d26-8919-992c6d77f207 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments/80521c6f-b725-4d03-a910-72817c68a637" status: 202 len: 0 microversion: 2.1 time: 0.323069 Sep 04 01:11:39.504742 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 270/535] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:11:39 2022] DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments/80521c6f-b725-4d03-a910-72817c68a637 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:11:39.511483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:39.517254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:39.519444 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:39.525895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:39.531765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:39.531765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:39.531765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:39.531765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:39.532131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:39.557573 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-33ae9cf0-4bc1-4099-a97f-ed4e8d481e3f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Sep 04 01:11:39.558129 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 266/536] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:11:39 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:11:40.570538 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:40.573092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:40.579414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:40.579895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:40.580331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:40.581050 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:40.581506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:40.581932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:40.612157 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37e3a907-f623-40c3-8b86-421d0b11d7d1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046331 Sep 04 01:11:40.612835 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 271/537] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:11:40 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:41.625288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:41.627451 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:41.634976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:41.636317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:41.636317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:41.636707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:41.637160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:41.637585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:41.668248 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2542cde2-25b7-4779-bcc2-aab575dc59cf tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047294 Sep 04 01:11:41.673022 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 267/538] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:11:41 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:42.681780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:42.683994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:42.690455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.690939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.691372 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:42.692051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.692526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.692953 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:42.723814 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aea88e24-171b-4cfc-9112-ab0023a6957b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046866 Sep 04 01:11:42.724410 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 272/539] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:11:42 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 04 01:11:42.787991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:42.788519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:42.795194 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.795684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.796131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:42.796858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.797319 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.797751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:42.825526 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:11:42.977790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:42.981724 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.981888 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.982329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:42.990617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:42.991082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:42.991510 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:43.005565 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-3bbf3b88-2757-4121-ab0b-d00b5e3bb114 req-f1d86605-fdee-4d7e-ad78-edd4720454bf admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a39b80bf-5a79-421b-a133-bf658475a5dd?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.a39b80bf-5a79-421b-a133-bf658475a5dd.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.076707 Sep 04 01:11:43.006223 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 273/540] 10.222.0.55 () {62 vars in 1800 bytes} [Sun Sep 4 01:11:42 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a39b80bf-5a79-421b-a133-bf658475a5dd?delete_info=%7B%22file_to_merge%22:%20%22volume-994858df-8167-4334-88e5-385beadd2261.a39b80bf-5a79-421b-a133-bf658475a5dd.vhdx%22,%20%22volume_id%22:%20%22994858df-8167-4334-88e5-385beadd2261%22%7D => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:11:43.088189 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-55ca9554-0da1-4cc5-afd8-f9ffefaae821 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 204 len: 0 microversion: 2.1 time: 0.303666 Sep 04 01:11:43.088945 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 268/541] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:11:42 2022] DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:11:43.097867 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:43.098572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:43.105682 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:43.106163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:43.106605 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:43.107284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:43.107753 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:43.108280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:43.239780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:43.248469 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32e101ac-c428-42e8-a01d-8363ea29c35f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1681 microversion: 2.1 time: 0.154917 Sep 04 01:11:43.249053 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 274/542] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:43 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:44.322328 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:44.323025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:44.328891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:44.329366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:44.329796 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:44.330470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:44.330922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:44.331341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:44.458349 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:44.466885 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b8119a58-ad40-4e5b-83d8-7732956acd68 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1681 microversion: 2.1 time: 0.198710 Sep 04 01:11:44.467451 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 269/543] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:44 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:45.490412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:45.490944 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:45.494017 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:11:45.494169 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sun Sep 4 01:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f (ip 10.222.0.27) !!! Sep 04 01:11:45.500369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:45.500881 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:45.501317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:45.502021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:45.502475 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:45.502899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:45.632785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:45.641485 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52f9a50c-d050-48f6-9979-d904b6db2800 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1681 microversion: 2.1 time: 0.154981 Sep 04 01:11:45.642052 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 275/544] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:45 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:46.665834 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:46.666575 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:46.673406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:46.673922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:46.674355 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:46.675071 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:46.676040 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:46.676168 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:46.737051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:46.745989 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2a3b8d77-b90f-4ac1-98b2-f51e6b51691b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1613 microversion: 2.1 time: 0.084898 Sep 04 01:11:46.746563 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 270/545] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:46 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:46.861426 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ae8c6a-0583-43a7-b43d-d920ad04325f", "name": "network-vif-deleted", "tag": "03ba5432-d158-4dfd-9e61-2dd4ffb23766"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:46.871703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:46.872173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:46.872631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:46.883553 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] Creating event network-vif-deleted:03ba5432-d158-4dfd-9e61-2dd4ffb23766 for instance c3ae8c6a-0583-43a7-b43d-d920ad04325f on hv-cinder-maste Sep 04 01:11:46.888866 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ef3d7c74-708c-4a83-8255-455535a8857b req-faf0f09c-366b-46a9-a8e3-db16623d3a4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Sep 04 01:11:46.893799 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 276/546] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:47.769423 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:47.769974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:47.777061 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:47.777564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:47.778000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:47.778684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:47.779135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:47.779554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:47.813020 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:47.813496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:47.813931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:47.814369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid c3ae8c6a-0583-43a7-b43d-d920ad04325f {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:11:47.857811 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:47.865445 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2a48dad5-70d8-4dd5-beea-750b1605eedb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 200 len: 1331 microversion: 2.1 time: 0.099888 Sep 04 01:11:47.868536 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 271/547] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:47 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:48.889163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:48.889864 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:48.896096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:48.900065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:48.900065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:48.900065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:48.900065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:48.900445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:48.912342 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f HTTP/1.1 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:11:48.913976 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:11:48.916343 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'c3ae8c6a-0583-43a7-b43d-d920ad04325f'} Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:11:48.917288 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:11:48.918727 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:48.920067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:11:48.920067 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69a3692b-d270-49a7-ad48-70f61a4653b1 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 404 len: 111 microversion: 2.1 time: 0.031926 Sep 04 01:11:48.920067 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 277/548] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:48 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:48.924976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2523e175-87cb-4fed-9aeb-f69ea67704aa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '.version_select at 0x7fba24a288b0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:49.002794 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:49.003283 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:49.009965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:49.010473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:49.010906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:49.011602 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:49.012052 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:49.012498 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:49.020369 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2523e175-87cb-4fed-9aeb-f69ea67704aa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330010867" status: 202 len: 0 microversion: 2.1 time: 0.099072 Sep 04 01:11:49.020977 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 272/549] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Sep 4 01:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330010867 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:11:49.095637 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lazy-loading 'services' on Instance uuid 742c96f8-ecdf-4be6-aef2-b623a653ae55 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:11:49.355996 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a686571-2b0d-4d12-9397-5d643ecfc0f8 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55/os-volume_attachments/994858df-8167-4334-88e5-385beadd2261" status: 202 len: 0 microversion: 2.1 time: 0.356846 Sep 04 01:11:49.356675 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 278/550] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:11:48 2022] DELETE /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55/os-volume_attachments/994858df-8167-4334-88e5-385beadd2261 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:11:50.034510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3e7a7712-84fc-43af-8703-fa5238381c55 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: .version_select at 0x7fba24a37a60>, body: {"keypair": {"name": "tempest-keypair-443764654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4QfCX2KPztlFqLdzElHFufPXLOT77jqz1AFSFDIQkaH7GQ8L9z8Qfk0F+4VkvXFhhxYvyK7ls4bli5xtrsCPl9AEZyV7fPmFQbINYgRjbBHiw9GUfQUCxk96e4YR31tw=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:50.050697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-3e7a7712-84fc-43af-8703-fa5238381c55 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:11:50.054450 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-3e7a7712-84fc-43af-8703-fa5238381c55 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:11:50.133601 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3e7a7712-84fc-43af-8703-fa5238381c55 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103687 Sep 04 01:11:50.134209 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 273/551] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:11:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:51.543612 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:51.544197 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:51.546858 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:11:51.547001 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sun Sep 4 01:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 (ip 10.222.0.27) !!! Sep 04 01:11:51.553404 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:51.553884 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:51.554320 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:51.555002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:51.555456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:51.555911 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:51.584565 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:11:51.802131 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be429a40-f0fc-436c-be62-bf49420ea582 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 204 len: 0 microversion: 2.1 time: 0.263387 Sep 04 01:11:51.802992 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 279/552] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:11:51 2022] DELETE /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:11:51.811679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:51.812298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:51.818985 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:51.819470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:51.819901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:51.820617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:51.821070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:51.821491 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:51.824827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=91,nova_cell1:INSERT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:51.958950 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:51.967193 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7521c59b-f1aa-4b4d-a188-ede08d02770e tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1514 microversion: 2.1 time: 0.159630 Sep 04 01:11:51.967763 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 274/553] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:51 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:52.231253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1603153524", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b20c706-eedb-40a9-af04-eb1e93ffe3a6"}], "security_groups": [{"name": "tempest-securitygroup--652499349"}], "key_name": "tempest-keypair-443764654", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:52.354491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] validate_networks() for [('2b20c706-eedb-40a9-af04-eb1e93ffe3a6', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:11:52.816889 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:11:52.817488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:11:52.817837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:11:52.818275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:11:52.818685 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:11:52.827304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:52.827780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:52.828220 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:52.828992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:52.829448 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:52.829875 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:52.835355 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=9 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:52.835988 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:11:52.848827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:11:52.852896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:11:52.864960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:11:52.867275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:11:52.989300 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a5af8b7-488c-48c4-8cae-a34812117e1a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.763016 Sep 04 01:11:52.990131 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 280/554] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:11:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:11:52.991025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:52.991836 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:52.999111 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:52.999640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:53.000229 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:53.000970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:53.001453 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:53.001588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65c9ae57-e7c9-4018-a8a5-a4ec7ea304fa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:53.002007 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:53.002137 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-65c9ae57-e7c9-4018-a8a5-a4ec7ea304fa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:53.063451 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-65c9ae57-e7c9-4018-a8a5-a4ec7ea304fa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:53.071427 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65c9ae57-e7c9-4018-a8a5-a4ec7ea304fa tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1241 microversion: 2.1 time: 0.073742 Sep 04 01:11:53.072234 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 281/555] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:52 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:53.148940 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:53.157600 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-544572d9-fe9e-4eb2-b6a7-90d77101cf35 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1514 microversion: 2.1 time: 0.171075 Sep 04 01:11:53.158185 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 275/556] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:52 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:54.094223 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:54.094842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:54.102060 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:54.102543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:54.102982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:54.103663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:54.104644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:54.105066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:54.165242 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:54.173437 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-586f1105-948d-4915-8f9f-1b50bdbed598 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1245 microversion: 2.1 time: 0.083378 Sep 04 01:11:54.173988 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 282/557] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:54 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:11:54.180744 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:54.181390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:54.188019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:54.188539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:54.188975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:54.189657 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:54.190113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:54.190566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:54.318061 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:54.326201 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-11045600-046b-47b3-9ee8-b3a6e3401fe6 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1514 microversion: 2.1 time: 0.149229 Sep 04 01:11:54.326764 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 276/558] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:54 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:55.195051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:55.195654 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:55.202612 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:55.203088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:55.203551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:55.204249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:55.204730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:55.205152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:55.269671 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:55.277609 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33c7fa63-8b86-42b3-807e-4f58693a1596 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1245 microversion: 2.1 time: 0.086357 Sep 04 01:11:55.278174 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 283/559] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:55 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:55.350710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:55.351320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:55.358259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:55.358735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:55.359166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:55.359844 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:55.360293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:55.360752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:55.484651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:55.493119 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f0695407-14ad-431a-b668-7389b80c2271 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1514 microversion: 2.1 time: 0.146300 Sep 04 01:11:55.493677 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 277/560] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:55 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:56.299828 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:56.300435 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:56.306858 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:56.307973 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:56.308450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:56.309142 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:56.309593 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:56.310046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:56.371106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:56.378925 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5605f456-64f8-469d-be2e-ba49c154b750 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1237 microversion: 2.1 time: 0.082987 Sep 04 01:11:56.379493 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 284/561] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:56 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:56.516535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:56.517173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:56.523490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:56.523968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:56.524397 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:56.525098 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:56.525549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:56.526580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:56.661290 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:56.670629 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2cfca59f-b10a-4e08-96f9-5ebd271f2a88 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1514 microversion: 2.1 time: 0.157829 Sep 04 01:11:56.671299 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 278/562] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:56 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:57.073706 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742c96f8-ecdf-4be6-aef2-b623a653ae55", "name": "network-vif-deleted", "tag": "b9900743-76d1-49ab-8971-909e2f2ba6a6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:11:57.083383 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.083883 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.084318 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.095499 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] Creating event network-vif-deleted:b9900743-76d1-49ab-8971-909e2f2ba6a6 for instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 on hv-cinder-maste Sep 04 01:11:57.100560 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6b1a4e2b-f7ee-432b-9bda-c189f134a822 req-08c4b6d5-a7dc-406f-a65a-13bf14da51b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030765 Sep 04 01:11:57.101140 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 285/563] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:11:57.403030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:57.403552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:57.409448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.409931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.410424 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.417956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.418489 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.421354 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.482186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:57.489745 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b17c5d68-f397-464a-b611-d4c893d55b81 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1237 microversion: 2.1 time: 0.091228 Sep 04 01:11:57.490460 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 279/564] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:57 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:57.695414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:57.696158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:57.703851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.704339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.704826 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.705520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.706015 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.706445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.741131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:57.741624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:57.742067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:57.742520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lazy-loading 'fault' on Instance uuid 742c96f8-ecdf-4be6-aef2-b623a653ae55 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:11:57.790448 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ddda0a1a0774b2da6bc75cbb10e094b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18076036cce84d48bc9df44f5b563bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:57.798821 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b38492fd-3a86-4c11-9c61-4ed36a661807 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 200 len: 1309 microversion: 2.1 time: 0.107684 Sep 04 01:11:57.799387 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 286/565] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:57 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:58.512852 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:58.513449 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:58.520037 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:58.520542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:58.520980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:58.521659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:58.522144 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:58.522566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:58.590232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:58.597842 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a7b2bc86-fe5e-49b5-abc4-90403e92bd4e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1301 microversion: 2.1 time: 0.089765 Sep 04 01:11:58.598667 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 280/566] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:58 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:11:58.822450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:58.824264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] [instance: 742c96f8-ecdf-4be6-aef2-b623a653ae55] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:58.831539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:58.832030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:58.832485 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:58.833203 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:58.833663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:58.834113 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:58.848284 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] HTTP exception thrown: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Request method failure captured: Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 HTTP/1.1 Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_qdsTEl1fg4LQYWu_AmwdmYaIK0qFNft5Skn_9QKj_QHO31y7MO3u7cWbHw5wsHaTNPVLHG_sdK3RknKP-PMbWZGr8ZMDn40MnWPgy9sPSEPSdhN9vjCIb3aL9AJw1CElXbidUlgIrgUyKbD00McyeHn31HvLNux8liFta4nFq4OQw Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 18076036cce84d48bc9df44f5b563bac Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:11:58.852804 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18076036cce84d48bc9df44f5b563bac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18076036cce84d48bc9df44f5b563bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 18076036cce84d48bc9df44f5b563bac Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2019146987 Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotTestJSON-2019146987-project Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 6ddda0a1a0774b2da6bc75cbb10e094b Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotTestJSON-2019146987-project Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. Sep 04 01:11:58.854519 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '742c96f8-ecdf-4be6-aef2-b623a653ae55'} Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:11:58.855404 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. Sep 04 01:11:58.856826 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:11:58.858266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] Returning 404 to user: Instance 742c96f8-ecdf-4be6-aef2-b623a653ae55 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:11:58.858266 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80ca831b-1578-4652-91d9-f7e5ff3ac190 tempest-VolumesSnapshotTestJSON-2019146987 tempest-VolumesSnapshotTestJSON-2019146987-project] 10.222.0.27 "GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55" status: 404 len: 111 microversion: 2.1 time: 0.033059 Sep 04 01:11:58.858266 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 287/567] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:58 2022] GET /compute/v2.1/servers/742c96f8-ecdf-4be6-aef2-b623a653ae55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:11:59.622963 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:11:59.624036 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:11:59.630291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:59.630777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:59.631220 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:59.631922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:11:59.632380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:11:59.632838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:11:59.766152 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:11:59.773828 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-611908ed-7a36-4ca3-a71f-8a713851ab74 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.156040 Sep 04 01:11:59.774397 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 281/568] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:11:59 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:12:00.339943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc97e3ab-3fc3-4d50-991c-fc91c80b97e1", "tag": "5440d337-e806-4dac-94e1-00febf7b2d00"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:00.349857 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:00.350332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:00.350756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:00.362150 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] Creating event network-changed:5440d337-e806-4dac-94e1-00febf7b2d00 for instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 on hv-cinder-maste Sep 04 01:12:00.367043 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a05f8283-a281-4d88-9bd3-3bc7a88022bf req-d7d7a236-031f-4d5b-8b2a-19edfc20c72c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031845 Sep 04 01:12:00.367644 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 288/569] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:00.797423 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:00.798070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:00.799933 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=4 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:00.805078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:00.805563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:00.806004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:00.806698 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:00.808407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:00.808892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:00.938901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:00.946561 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f58dc8ea-dcaa-4b0c-a74d-1b5576f93d78 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.152991 Sep 04 01:12:00.947132 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 282/570] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:00 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:01.970935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:01.971792 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:01.973774 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:01.978625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:01.979870 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:01.980489 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:01.981188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:01.981645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:01.982076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:02.113106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:02.120827 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d50edbd8-e161-46aa-b530-eb862fbea74a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.154549 Sep 04 01:12:02.121354 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 289/571] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:01 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:03.144627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:03.145243 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:03.147414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:03.152595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:03.153127 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:03.153580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:03.154268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:03.154726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:03.155170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:03.285917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:03.294582 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ee6ed429-27e4-4aa0-9b3a-a4f29797ee3a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.153973 Sep 04 01:12:03.299433 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 283/572] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:03 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:03.803663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:03.804906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:03.905633 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:03.906162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:03.912587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:03.913069 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:03.913502 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:03.914180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:03.914635 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:03.915058 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:03.944133 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52896237-e0d1-45e6-b5f7-16369ca9a9dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments/aae2319d-9c16-432d-837d-7943c04a7bf5" status: 200 len: 194 microversion: 2.20 time: 0.145116 Sep 04 01:12:03.944812 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 290/573] 10.222.0.27 () {60 vars in 1454 bytes} [Sun Sep 4 01:12:03 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments/aae2319d-9c16-432d-837d-7943c04a7bf5 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:12:04.014023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:04.014521 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:04.020840 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.021325 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.021760 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.022447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.022907 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.023333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.149788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lazy-loading 'services' on Instance uuid 1824238e-f644-41a1-981f-e90d40bbbdfc {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:04.317108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:04.317643 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:04.326699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.326699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.326699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.326699 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.327099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.327099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.407865 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a6b1e05b-6e37-4522-b357-d3e857987d21 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments/aae2319d-9c16-432d-837d-7943c04a7bf5" status: 202 len: 0 microversion: 2.20 time: 0.398317 Sep 04 01:12:04.408575 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 284/574] 10.222.0.27 () {60 vars in 1457 bytes} [Sun Sep 4 01:12:04 2022] DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments/aae2319d-9c16-432d-837d-7943c04a7bf5 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:12:04.417865 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:04.420192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:04.426642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.427127 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.427569 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.428293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:04.428874 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:04.429305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:04.459842 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-af792406-2e2f-46df-849f-6d2518c7bed4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046724 Sep 04 01:12:04.460407 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 285/575] 10.222.0.27 () {60 vars in 1343 bytes} [Sun Sep 4 01:12:04 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 01:12:04.471103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:04.478736 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f87febdf-3355-406f-b2a8-8eb51f2248e7 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.165653 Sep 04 01:12:04.479295 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 291/576] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:04 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:05.472728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:05.474939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:05.481625 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:05.482048 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:05.482483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:05.483181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:05.483789 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:05.484221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:05.502835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:05.503574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:05.510314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:05.510801 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:05.511237 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:05.511926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:05.513016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:05.513726 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:05.516601 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-331e6206-79a4-438e-a9e8-524e09f3af4b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047606 Sep 04 01:12:05.518284 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 286/577] 10.222.0.27 () {60 vars in 1343 bytes} [Sun Sep 4 01:12:05 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:12:05.648297 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:05.656556 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a46fa93a-1a3e-402b-9459-5d6f8f1dc412 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.157413 Sep 04 01:12:05.657075 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 292/578] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:05 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:12:06.285130 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc97e3ab-3fc3-4d50-991c-fc91c80b97e1", "name": "network-vif-plugged", "status": "completed", "tag": "5440d337-e806-4dac-94e1-00febf7b2d00"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:06.295157 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.295634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.296061 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.306895 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] Creating event network-vif-plugged:5440d337-e806-4dac-94e1-00febf7b2d00 for instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 on hv-cinder-maste Sep 04 01:12:06.311855 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-8ed77415-9bb1-44fd-a06d-e21cc27a8db5 req-cfa894e6-b029-4915-b80a-259575d9e4db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 Sep 04 01:12:06.312423 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 287/579] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:06.531947 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:06.534286 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:06.540804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.541295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.543187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.543187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.543187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.543457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.572192 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a823fbc-740b-42dd-9b55-045e80404486 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044968 Sep 04 01:12:06.572780 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 293/580] 10.222.0.27 () {60 vars in 1343 bytes} [Sun Sep 4 01:12:06 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:06.637116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:06.638901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:06.645871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.646360 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.646800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.647493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.648439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.648914 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.675342 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:12:06.678912 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:06.679514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:06.686367 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.686976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.687430 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.688100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.688581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.689640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.839403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:06.847624 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20f06d08-ad88-4866-ba15-fdf94c5deab4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.172657 Sep 04 01:12:06.848196 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 294/581] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:06 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:12:06.898985 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e03a2faf-c259-4e02-9f9f-7a05ab169398 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 204 len: 0 microversion: 2.20 time: 0.266237 Sep 04 01:12:06.899567 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 288/582] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Sep 4 01:12:06 2022] DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 01:12:06.907986 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:06.908851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:06.914756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.915230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.915660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:06.916331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:06.916811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:06.917233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:07.050066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:07.058466 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:07.060746 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:07.061918 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77f8aa0c-4eec-4214-a210-97efbcfa31ff tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.158138 Sep 04 01:12:07.062696 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 295/583] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:06 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:07.870889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:07.871513 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:07.878491 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:07.878968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:07.879465 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:07.880193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:07.880710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:07.881133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:07.883710 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:08.013096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:08.020541 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d9ba88d8-997c-4e04-af65-698d143856ba tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.153982 Sep 04 01:12:08.021103 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 289/584] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:07 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:08.088600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:08.089214 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:08.095615 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:08.096123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:08.096588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:08.097275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:08.097733 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:08.098163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:08.226897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:08.235836 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:08.237325 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:08.238505 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-028fd96b-783e-4921-b76b-0870e9e2b269 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.153858 Sep 04 01:12:08.239127 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 296/585] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:08 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:09.043338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:09.044042 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:09.051014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:09.051500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:09.051942 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:09.052660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:09.053120 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:09.053559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:09.187259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:09.196021 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3a22bf84-2ba3-412c-a098-68eee9269973 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1366 microversion: 2.1 time: 0.156960 Sep 04 01:12:09.196653 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 290/586] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:09 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:09.265785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:09.266229 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:09.272671 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:09.273157 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:09.273591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:09.274273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:09.274727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:09.275153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:09.406842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:09.415087 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:09.416561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:09.417750 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f3b402f-9960-4537-8c8f-8df0ca5a2d43 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.157128 Sep 04 01:12:09.418318 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 297/587] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:09 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:10.219846 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:10.220563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:10.227970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.228640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.235535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.235535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.235535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.235535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.379699 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:10.390599 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-560262f9-4ee6-44e0-92f8-965819a6b74c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1556 microversion: 2.1 time: 0.174934 Sep 04 01:12:10.391183 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 291/588] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:10 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:10.413053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:10.413592 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:10.421937 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.425516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.425516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.425516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.425516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.425922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.444105 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:10.444869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:10.451554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.452161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.452723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.453478 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:10.454023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:10.454512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:10.541360 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02d3defb-6398-4366-a4d8-19d826e74d71 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132282 Sep 04 01:12:10.542125 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 298/589] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:12:10 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:10.669860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:10.680027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:10.682584 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:10.688402 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d4f9a9f0-a69b-46b2-8b73-7a2f302745fe tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1720 microversion: 2.20 time: 0.246651 Sep 04 01:12:10.692891 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 292/590] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:10 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:12:11.462017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1824238e-f644-41a1-981f-e90d40bbbdfc", "name": "network-vif-deleted", "tag": "b0b604de-d50c-4b86-8f56-a8b0405bff47"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:11.475303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:11.475303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:11.475303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:11.489676 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] Creating event network-vif-deleted:b0b604de-d50c-4b86-8f56-a8b0405bff47 for instance 1824238e-f644-41a1-981f-e90d40bbbdfc on hv-cinder-maste Sep 04 01:12:11.495971 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-65652fcf-b1f1-4b61-9fc4-b1a7b126cd00 req-8180bebb-c839-4563-9148-b565e7e8c146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101011 Sep 04 01:12:11.498077 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 299/591] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:11.721108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:11.722351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:11.734020 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:11.734746 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:11.735488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:11.736363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:11.737188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:11.737767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:11.773087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:11.773824 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:11.774411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:11.774929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lazy-loading 'fault' on Instance uuid 1824238e-f644-41a1-981f-e90d40bbbdfc {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:11.846348 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:11.854966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:11.856780 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:11.858192 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-781b3af9-20d2-4749-a565-2f138844d487 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 200 len: 1371 microversion: 2.20 time: 0.141608 Sep 04 01:12:11.859211 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 293/592] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:11 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:11.936992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc97e3ab-3fc3-4d50-991c-fc91c80b97e1", "tag": "5440d337-e806-4dac-94e1-00febf7b2d00"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:11.949066 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:11.949603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:11.950834 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:11.966572 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] Creating event network-changed:5440d337-e806-4dac-94e1-00febf7b2d00 for instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 on hv-cinder-maste Sep 04 01:12:11.971962 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f4cc587c-4843-4a6c-b219-9d587558d6fa req-1276b632-6398-4d0d-bee6-34c0d05b6d69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101943 Sep 04 01:12:11.973194 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 300/593] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:12.884188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:12.885084 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:12.892317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:12.893030 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:12.893646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:12.894528 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:12.895161 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:12.895770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:12.911242 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc HTTP/1.1 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:12:12.913000 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:12:12.914681 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '1824238e-f644-41a1-981f-e90d40bbbdfc'} Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:12:12.915586 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:12:12.917161 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:12.919192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:12:12.919192 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-456ea3a4-eb9c-4392-ae5f-1db2d9425663 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 404 len: 111 microversion: 2.20 time: 0.034079 Sep 04 01:12:12.919192 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 294/594] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:12 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:12:12.925936 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6f6b7af-764e-4407-913f-6a97b8e56088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '.version_select at 0x7fba24aa4e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:13.020548 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6f6b7af-764e-4407-913f-6a97b8e56088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893355089" status: 204 len: 0 microversion: 2.20 time: 0.099632 Sep 04 01:12:13.021195 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 301/595] 10.222.0.27 () {60 vars in 1262 bytes} [Sun Sep 4 01:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893355089 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 01:12:13.815024 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1158173d-fa50-45ae-a9df-fbf4d3306bf1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: .version_select at 0x7fba24b2a3a0>, body: {"keypair": {"name": "tempest-keypair-781119800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUBnaBCA9dXEclUBc0gQkWHX1n38KH7DzXNZJZbvQwmDnuzYmVI26vc3GQss4FrM8wuIxAeQ6dNKck8I3vyt2gS/vqbaxeFQ+pYcUDetij+P/zJ9Nx7YyqPeVtAhytw9w=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:13.830250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-1158173d-fa50-45ae-a9df-fbf4d3306bf1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:12:13.834015 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-1158173d-fa50-45ae-a9df-fbf4d3306bf1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for user bd1c41fcdc724a128117a5288b8559f5 and project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:12:13.910620 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1158173d-fa50-45ae-a9df-fbf4d3306bf1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.099439 Sep 04 01:12:13.911263 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 295/596] 10.222.0.27 () {62 vars in 1200 bytes} [Sun Sep 4 01:12:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 04 01:12:16.084499 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-452980054", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "761493cb-9c37-4208-8cf3-32be61673510"}], "security_groups": [{"name": "tempest-securitygroup--2019390123"}], "key_name": "tempest-keypair-781119800", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:16.188121 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] validate_networks() for [('761493cb-9c37-4208-8cf3-32be61673510', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:12:16.554527 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:12:16.554955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:12:16.555456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:12:16.555865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:12:16.556304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:12:16.565251 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:16.565724 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:16.566156 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:16.566865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:16.567315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:16.567736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:16.583716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:12:16.587595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Getting quotas for user bd1c41fcdc724a128117a5288b8559f5 and project e334b7aa2f1848c1999d86ac666fe65e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:12:16.599434 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:12:16.601819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:12:16.734698 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02d4b915-c083-4f5a-9ad3-5397f9166038 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.655246 Sep 04 01:12:16.735290 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 302/597] 10.222.0.27 () {62 vars in 1188 bytes} [Sun Sep 4 01:12:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 04 01:12:16.746295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:16.747683 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:16.807251 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:16.815138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:16.816621 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:16.817713 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4fb5464d-2e63-4bba-aff6-e3827204e89f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1280 microversion: 2.20 time: 0.075352 Sep 04 01:12:16.818268 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 296/598] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:16 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:17.843317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:17.843932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:17.851728 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:17.852215 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:17.852695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:17.853392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:17.853852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:17.854305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:17.869097 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:17.916041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:17.924268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:17.925760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:17.926858 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57e18803-9b3c-4e8e-933f-a0470701bab4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1284 microversion: 2.20 time: 0.088353 Sep 04 01:12:17.927413 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 303/599] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:17 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:18.953467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:18.954182 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:18.960949 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:18.961512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:18.962479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:18.963236 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:18.963704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:18.964140 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:19.030264 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:19.038677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:19.040242 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:19.041379 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1bf1e3c1-221f-46cb-a254-2bb9d636f378 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1340 microversion: 2.20 time: 0.092598 Sep 04 01:12:19.041957 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 297/600] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:18 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:20.065455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:20.066167 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:20.073112 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:20.073613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:20.074043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:20.075198 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:20.075655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:20.076258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:20.267587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:20.275896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:20.277369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:20.278786 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ce908eb-a210-44ab-9741-04c1fffa0836 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.217101 Sep 04 01:12:20.279354 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 304/601] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:20 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:12:20.641985 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:20.651281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:20.651750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:20.653628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:20.663286 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] Creating event network-changed:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:12:20.668053 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-bf6cb773-f09c-40c9-aae6-9eb6d482d563 req-1018d2de-c38f-4e42-bf5e-3ae6bbba599c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 Sep 04 01:12:20.672204 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 298/602] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:12:21.303366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:21.303990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:21.310798 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:21.312324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:21.312324 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:21.312609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:21.312895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:21.313322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:21.494536 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:21.503424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:21.504894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:21.505987 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9162435-3593-4793-9fdf-86efff974b4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.206654 Sep 04 01:12:21.506559 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 305/603] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:21 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:12:21.995426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:21.997382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:22.002749 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.003266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.003709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.004395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.004881 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.005308 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.087126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'services' on Instance uuid d25a562c-8571-4621-9cb2-3286e7a64666 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:22.282700 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f53c939a-e1e9-4232-b6d3-1ec79fc21c64 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments/3a64d6e2-09f5-441e-b44e-030d8e923ac0" status: 202 len: 0 microversion: 2.1 time: 0.291864 Sep 04 01:12:22.283416 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 299/604] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:12:21 2022] DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments/3a64d6e2-09f5-441e-b44e-030d8e923ac0 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:12:22.291737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:22.294152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:22.300369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.300970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.301409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.302148 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.302561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.309687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.336127 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc2e316c-1ce7-4307-a522-00dfc2b31ec6 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048076 Sep 04 01:12:22.336943 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 306/605] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:12:22 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:22.532361 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:22.533002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:22.539070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.539550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.539980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.540714 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:22.541153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:22.541636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:22.673468 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:22.681180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:22.682623 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:22.683733 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-03623811-b62f-4725-b988-d20ddceedce0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.155858 Sep 04 01:12:22.685383 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 300/606] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:22 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:23.349572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:23.351670 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:23.359152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:23.359640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:23.360078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:23.360807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:23.361267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:23.361693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:23.393048 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2d0763b-6594-4c93-ba4b-5ab67eb59ba1 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047584 Sep 04 01:12:23.393613 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 307/607] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:12:23 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:23.710098 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:23.710640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:23.718359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:23.718846 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:23.719268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:23.719979 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:23.720435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:23.720884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:23.849982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:23.858092 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:23.859537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:23.860666 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a6098dd7-434e-4ecd-a00b-ec0736c3e8b3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.154507 Sep 04 01:12:23.861231 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 301/608] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:23 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:24.405186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:24.407331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:24.413797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:24.414938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:24.415378 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:24.416293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:24.416772 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:24.417197 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:24.449080 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74c39c6f-30e3-499c-804e-2691a8e5f5e3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047978 Sep 04 01:12:24.449961 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 308/609] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:12:24 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:24.884615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:24.885485 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:24.892278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:24.892796 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:24.893238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:24.893931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:24.894390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:24.894824 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.025090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:25.035101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:25.036559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:25.037772 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fd774d04-2aad-4892-835d-25fd096fbfb1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.156965 Sep 04 01:12:25.038337 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 302/610] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:24 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:25.461469 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:25.463583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:25.469878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.470351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.470786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.471453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.471900 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.472318 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.501067 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66749532-9f03-4964-b603-d371ef09ecf3 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043469 Sep 04 01:12:25.501620 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 309/611] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:12:25 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:12:25.579982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:25.580509 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:25.586366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.586869 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.587294 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.587983 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.588445 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.588899 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.613829 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:12:25.836671 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5be156f4-730b-40a4-8fd6-67cc7e68a966 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 204 len: 0 microversion: 2.1 time: 0.260040 Sep 04 01:12:25.837193 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 303/612] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:12:25 2022] DELETE /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:12:25.845374 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:25.846039 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:25.852748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.853252 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.854868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.854868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:25.854868 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:25.855239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:25.984722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:25.992266 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93ff86f0-306a-4e31-8faa-ff4ef64b1567 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1687 microversion: 2.1 time: 0.150887 Sep 04 01:12:25.992930 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 310/613] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:25 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:26.063088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:26.063793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:26.070162 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:26.070646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:26.071146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:26.071832 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:26.072291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:26.072748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:26.206838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:26.214908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:26.216600 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:26.217706 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d778556d-62cf-4164-93e1-78306e963e90 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.158899 Sep 04 01:12:26.218447 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 304/614] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:26 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:26.575591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:26.587350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "name": "network-vif-plugged", "status": "completed", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:26.595110 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:26.597264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:26.597736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:26.598160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:26.609842 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] Creating event network-vif-plugged:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:12:26.614838 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d68b7e27-59f5-4a26-8a29-97402fc6c5ee req-5358c762-00d4-4bdb-a582-4f5f7bdf4817 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209075 Sep 04 01:12:26.615414 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 311/615] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:27.015544 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:27.016158 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:27.018295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:27.023008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:27.023493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:27.023926 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:27.024642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:27.025091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:27.025511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:27.153617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:27.161398 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-670c45bf-b915-4d41-a098-4ffc129844e5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1687 microversion: 2.1 time: 0.149746 Sep 04 01:12:27.161953 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 305/616] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:27 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:27.244042 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:27.244764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:27.251035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:27.251516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:27.251940 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:27.252646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:27.253094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:27.253513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:27.382084 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:27.390996 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:27.392523 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:27.393620 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54312163-be71-4987-a9cd-5323b3649fba tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.154204 Sep 04 01:12:27.394255 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 312/617] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:27 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:28.185394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:28.186023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:28.192630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:28.193121 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:28.193578 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:28.194262 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:28.194722 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:28.195155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:28.210635 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:28.330179 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:28.337757 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-45199ae8-bd5b-42a6-af5e-8e65c865245f tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1687 microversion: 2.1 time: 0.157007 Sep 04 01:12:28.338321 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 306/618] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:28 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:28.418965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:28.419861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:28.426461 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:28.426938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:28.427370 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:28.428103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:28.428579 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:28.429002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:28.555165 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:28.563317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:28.564769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:28.565862 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77e1d32f-b09a-49c0-87cd-234390c10bb2 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.151526 Sep 04 01:12:28.566428 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 313/619] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:28 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:29.362033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:29.362640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:29.369049 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:29.369523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:29.369953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:29.370628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:29.371082 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:29.372102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:29.498053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:29.505628 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-50924980-c4b2-4d2c-9ab2-3c14f6e0e91b tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1687 microversion: 2.1 time: 0.147461 Sep 04 01:12:29.506192 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 307/620] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:29 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:29.591251 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:29.592068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:29.598621 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:29.599104 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:29.599543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:29.600233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:29.600717 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:29.601143 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:29.731328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:29.739893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:29.741437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:29.742526 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45c1d3fd-53eb-4556-ad28-aaf04131c8f6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.155318 Sep 04 01:12:29.743099 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 314/621] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:29 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:30.484253 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25a562c-8571-4621-9cb2-3286e7a64666", "name": "network-vif-deleted", "tag": "26fcdf65-4bc4-463f-a658-90e8cfaeab8a"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:30.494358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:30.494840 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:30.495307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:30.508965 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] Creating event network-vif-deleted:26fcdf65-4bc4-463f-a658-90e8cfaeab8a for instance d25a562c-8571-4621-9cb2-3286e7a64666 on hv-cinder-maste Sep 04 01:12:30.514962 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-876a4ae1-2ea7-4d70-aea7-239875709625 req-0d7c6b3e-e194-46e0-8f4a-22ddf95b5c22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Sep 04 01:12:30.515938 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 308/622] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:30.529487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:30.530247 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:30.536547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:30.537040 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:30.537474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:30.538180 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:30.538637 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:30.539062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:30.612299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:30.641230 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d07dc95-36a3-4603-8240-bedd2dae8d72 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1619 microversion: 2.1 time: 0.115624 Sep 04 01:12:30.645409 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 315/623] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:30 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1619 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:30.769097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:30.769792 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:30.775892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:30.776322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:30.776849 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:30.777535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:30.778037 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:30.778457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:30.951175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:30.960080 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:30.961743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:30.962894 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-332c7db7-e88a-4472-bdb9-ea748a401a5b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1406 microversion: 2.20 time: 0.198005 Sep 04 01:12:30.963431 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 309/624] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:30 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:31.668148 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:31.669509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:31.676236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:31.677022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:31.677465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:31.678409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:31.679025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:31.679628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:31.715857 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:31.716428 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:31.716938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:31.717392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'fault' on Instance uuid d25a562c-8571-4621-9cb2-3286e7a64666 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:31.761603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:31.770432 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52d14ccd-f2b8-4a25-8c09-aa4b9a171b45 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 200 len: 1333 microversion: 2.1 time: 0.108112 Sep 04 01:12:31.771116 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 316/625] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:31 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:31.987854 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:31.988531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:31.994833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:31.995318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:31.995757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:31.996519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:31.997806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:31.998276 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:32.172270 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:32.180741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:32.182186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:32.183346 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e761555f-2b5c-4cf1-9b5e-92e7b1efbfd3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1595 microversion: 2.20 time: 0.199390 Sep 04 01:12:32.183916 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 310/626] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:12:31 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1595 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:12:32.213405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:32.214040 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:32.216347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:32.233848 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:32.234347 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:32.234787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:32.235500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:32.235961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:32.236387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:32.323297 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb98e242-3054-4b95-b854-9e805549da6e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.114790 Sep 04 01:12:32.328897 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 317/627] 10.222.0.27 () {60 vars in 1316 bytes} [Sun Sep 4 01:12:32 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:12:32.794834 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:32.795460 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: d25a562c-8571-4621-9cb2-3286e7a64666] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:32.802080 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:32.802670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:32.803118 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:32.803830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:32.804294 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:32.804754 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:32.819498 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] HTTP exception thrown: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Request method failure captured: Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 HTTP/1.1 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_ojnIhf8QVAWOLmBUuPtp-OcMLB2jl2xoYk_UXPuLR3073mpe-jTWfPsQtIkzLDhrpisUO28mpJlYeP7jAcWi8NysA4o6BRfz_DYUkt_bPEJtd84G1xFWvwJI5AZbgfBkJ4EnThfaZBq0i8UcgXIxnEJRCO8YpI-Vezoyo08TLG9fE Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:12:32.821259 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dbf47189fc4f3c90eadc4887a831b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9bef8dc1da4c44dbbafcaf3c813b3262 Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. Sep 04 01:12:32.822568 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'd25a562c-8571-4621-9cb2-3286e7a64666'} Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:12:32.823346 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. Sep 04 01:12:32.825207 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:32.826232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Returning 404 to user: Instance d25a562c-8571-4621-9cb2-3286e7a64666 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:12:32.826232 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-af74c281-6d01-46c7-9974-d6f7f6a41fe0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666" status: 404 len: 111 microversion: 2.1 time: 0.032650 Sep 04 01:12:32.826232 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 311/628] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:32 2022] GET /compute/v2.1/servers/d25a562c-8571-4621-9cb2-3286e7a64666 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:32.833773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff0adb16-660a-41c1-8327-1506c2597a6e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '.version_select at 0x7fba24892700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:32.912164 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff0adb16-660a-41c1-8327-1506c2597a6e tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7967966" status: 202 len: 0 microversion: 2.1 time: 0.084126 Sep 04 01:12:32.912820 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 318/629] 10.222.0.27 () {58 vars in 1212 bytes} [Sun Sep 4 01:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7967966 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:12:33.633400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:33.643429 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:33.645971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:33.645971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:33.656439 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] Creating event network-changed:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:12:33.661491 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-fe68f224-2abf-4274-9aae-3df5dbae4c0d req-71e2a45f-d2f7-43d6-918e-94c2c0676076 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031697 Sep 04 01:12:33.662610 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 312/630] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:36.177059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:36.177552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:36.183362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:36.183840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:36.184279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:36.184982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:36.185438 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:36.185865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:36.211411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:12:36.521769 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db919988-6849-4757-a01a-f28b0d86a119 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 204 len: 0 microversion: 2.1 time: 0.348838 Sep 04 01:12:36.522362 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 319/631] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:12:36 2022] DELETE /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:12:36.531158 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:36.531873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:36.534507 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:36.539489 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:36.539976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:36.540421 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:36.541134 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:36.541599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:36.542082 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:36.675860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:36.683488 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c454434f-7564-4e47-a7b6-75a044ab09bc tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1507 microversion: 2.1 time: 0.156628 Sep 04 01:12:36.684558 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 313/632] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:36 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:37.706916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:37.707648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:37.714199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:37.714677 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:37.715712 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:37.716442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:37.716917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:37.717343 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:37.721341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:37.845735 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:37.853442 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17cc95d6-f97b-4218-9cbe-28dc41042e63 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1507 microversion: 2.1 time: 0.150682 Sep 04 01:12:37.854019 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 320/633] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:37 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:38.853830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e477c1-a604-4738-96c1-c984698ba6b6", "name": "network-vif-deleted", "tag": "9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:38.859632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:38.860167 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:38.860659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:38.873001 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] Creating event network-vif-deleted:9fa8cd8f-9f3c-4fc6-8f4b-295f7ff655ae for instance 90e477c1-a604-4738-96c1-c984698ba6b6 on hv-cinder-maste Sep 04 01:12:38.877349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:38.878053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:38.878262 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-cf8bea3d-d817-4b44-bf88-ffe055f5e2f5 req-582cd2c4-9841-4653-9e0c-00bcb001a3b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034357 Sep 04 01:12:38.879022 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 314/634] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:38.885228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:38.885796 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:38.886636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:38.887374 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:38.887900 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:38.888337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:38.956426 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:38.964584 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-604277f6-9a82-4cdd-a851-05e5cb44b158 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1465 microversion: 2.1 time: 0.091378 Sep 04 01:12:38.965702 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 321/635] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:38 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1465 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:12:39.989764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:39.990463 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:39.997496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:39.997979 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:39.998466 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:39.999228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:39.999681 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:40.000609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:40.034241 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:40.034739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:40.035191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:40.035642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'fault' on Instance uuid 90e477c1-a604-4738-96c1-c984698ba6b6 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:40.080612 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:40.088200 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9b84fbc3-d168-4e3e-9256-633c16b0dfd0 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 200 len: 1312 microversion: 2.1 time: 0.103245 Sep 04 01:12:40.088916 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 315/636] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:39 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:41.115022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:41.115650 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: 90e477c1-a604-4738-96c1-c984698ba6b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:41.122140 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.122606 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.123033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.123704 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.124151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.124600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.138060 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] HTTP exception thrown: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Request method failure captured: Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 HTTP/1.1 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_ojnIhf8QVAWOLmBUuPtp-OcMLB2jl2xoYk_UXPuLR3073mpe-jTWfPsQtIkzLDhrpisUO28mpJlYeP7jAcWi8NysA4o6BRfz_DYUkt_bPEJtd84G1xFWvwJI5AZbgfBkJ4EnThfaZBq0i8UcgXIxnEJRCO8YpI-Vezoyo08TLG9fE Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:12:41.139755 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dbf47189fc4f3c90eadc4887a831b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 9bef8dc1da4c44dbbafcaf3c813b3262 Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. Sep 04 01:12:41.141397 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '90e477c1-a604-4738-96c1-c984698ba6b6'} Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:12:41.142307 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. Sep 04 01:12:41.143950 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:12:41.145513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Returning 404 to user: Instance 90e477c1-a604-4738-96c1-c984698ba6b6 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:12:41.145513 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1206be2a-0c28-47d4-bab4-c3da186fe200 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6" status: 404 len: 111 microversion: 2.1 time: 0.030064 Sep 04 01:12:41.145513 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 322/637] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:41 2022] GET /compute/v2.1/servers/90e477c1-a604-4738-96c1-c984698ba6b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:41.149577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:41.150069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:41.156908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.157385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.157820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.158495 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.158946 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.159369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.186389 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:12:41.430675 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ee7c9def-60fb-4a6f-a6d2-35eedb9d7db7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 204 len: 0 microversion: 2.1 time: 0.284472 Sep 04 01:12:41.431205 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 316/638] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:12:41 2022] DELETE /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:12:41.439079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:41.439743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:41.445665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.446139 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.446574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.447246 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:41.447694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:41.448113 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:41.574170 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:41.582450 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4296c13-1d8e-4265-8c20-c6fa289325a8 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.147081 Sep 04 01:12:41.583007 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 323/639] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:41 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:12:42.606767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:42.607479 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:42.613930 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:42.619156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:42.619156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:42.619156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:42.619156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:42.619670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:42.744102 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:42.751855 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e1b11821-b45f-4cec-a079-4fc241e374a7 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.149935 Sep 04 01:12:42.752407 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 317/640] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:42 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:43.775097 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:43.775810 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:43.782983 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:43.783464 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:43.783923 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:43.784660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:43.785114 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:43.785537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:43.915964 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:43.924053 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f13d772-5941-414f-a19c-70ca646b2604 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1522 microversion: 2.1 time: 0.152808 Sep 04 01:12:43.924632 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 324/641] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:43 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:44.572483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c63d7-e34c-4215-a9e0-bc69fe40f7d6", "name": "network-vif-deleted", "tag": "e6762f01-9b63-4b08-a547-83d1ec09e9b6"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:44.583392 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:44.583875 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:44.584343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:44.596202 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] Creating event network-vif-deleted:e6762f01-9b63-4b08-a547-83d1ec09e9b6 for instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 on hv-cinder-maste Sep 04 01:12:44.601045 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-2db3f8af-3ea1-4c71-b7e9-6e1767b51d46 req-475cb3ff-296f-452d-afa2-400fc5ff51fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Sep 04 01:12:44.601743 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 318/642] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:12:44.947375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:44.948096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:44.958669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:44.959163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:44.959610 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:44.960315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:44.960807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:44.965437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:44.995017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:44.995500 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:44.995939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:44.996965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lazy-loading 'fault' on Instance uuid f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:45.040664 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bef8dc1da4c44dbbafcaf3c813b3262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dbf47189fc4f3c90eadc4887a831b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:45.048334 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4438f708-f900-4bb3-a322-d9e63be5b2d4 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 200 len: 1312 microversion: 2.1 time: 0.105097 Sep 04 01:12:45.048929 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 325/643] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:44 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:46.077377 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:46.078108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] [instance: f16c63d7-e34c-4215-a9e0-bc69fe40f7d6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:46.084109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:46.084622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:46.085056 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:46.085733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:46.086184 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:46.086606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:46.100244 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] HTTP exception thrown: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Request method failure captured: Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 HTTP/1.1 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_ojnIhf8QVAWOLmBUuPtp-OcMLB2jl2xoYk_UXPuLR3073mpe-jTWfPsQtIkzLDhrpisUO28mpJlYeP7jAcWi8NysA4o6BRfz_DYUkt_bPEJtd84G1xFWvwJI5AZbgfBkJ4EnThfaZBq0i8UcgXIxnEJRCO8YpI-Vezoyo08TLG9fE Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:12:46.101839 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51dbf47189fc4f3c90eadc4887a831b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51dbf47189fc4f3c90eadc4887a831b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 51dbf47189fc4f3c90eadc4887a831b8 Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211826213 Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 9bef8dc1da4c44dbbafcaf3c813b3262 Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211826213-project Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. Sep 04 01:12:46.103337 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'f16c63d7-e34c-4215-a9e0-bc69fe40f7d6'} Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:12:46.104285 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. Sep 04 01:12:46.105911 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:12:46.107192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] Returning 404 to user: Instance f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:12:46.107192 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-38f22d37-99c1-4bf5-b17e-196428b526b5 tempest-ServerRescueNegativeTestJSON-211826213 tempest-ServerRescueNegativeTestJSON-211826213-project] 10.222.0.27 "GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6" status: 404 len: 111 microversion: 2.1 time: 0.031238 Sep 04 01:12:46.107192 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 319/644] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:46 2022] GET /compute/v2.1/servers/f16c63d7-e34c-4215-a9e0-bc69fe40f7d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:12:49.330929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:12:49.332089 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:49.339840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:49.350293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:49.350293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:49.350293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:49.350293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:49.350786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:49.379833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lazy-loading 'flavor' on Instance uuid cbf004ea-20d2-4dc5-aadf-adc76d645af3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:12:49.688220 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-031df751-94e1-448d-a233-00daceca00e1 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "POST /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3/action" status: 202 len: 0 microversion: 2.1 time: 0.361632 Sep 04 01:12:49.688972 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 326/645] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:12:49 2022] POST /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:12:49.697572 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:49.698316 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:49.706004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:49.706631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:49.707179 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:49.707991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:49.708593 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:49.709264 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:49.945982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:49.955899 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5bfb1472-c01a-4131-89c8-6a5b22d0fa6f tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.262160 Sep 04 01:12:49.956849 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 320/646] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:49 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:50.981674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:50.982448 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:50.989202 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:50.989747 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:50.990246 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:50.991012 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:50.991368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:50.991858 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:51.131189 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:51.140080 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6954b19e-5541-49b9-885b-8b1b4f5f86a4 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.163467 Sep 04 01:12:51.140678 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 327/647] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:50 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:52.163276 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:52.163892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:52.171074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:52.171560 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:52.172002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:52.172768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:52.173237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:52.173667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:52.316953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:52.324967 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a7435edd-8f81-480c-a81c-61643168f738 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.165732 Sep 04 01:12:52.331118 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 321/648] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:52 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:53.350956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:53.351597 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:53.359260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:53.359836 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:53.360274 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:53.360985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:53.361433 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:53.361854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:53.493055 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:53.501329 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d7504b6-01f3-4122-a90d-8448e9ca9506 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.154855 Sep 04 01:12:53.501885 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 328/649] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:53 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:54.524659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:54.525365 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:54.531964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:54.532536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:54.533050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:54.533814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:54.534340 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:54.534857 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:54.668186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:54.676038 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2678138f-c515-4ee3-9344-fa1e15306307 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.155276 Sep 04 01:12:54.676724 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 322/650] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:54 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:55.701808 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:55.702545 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:55.709047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:55.709528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:55.709965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:55.712332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:55.712332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:55.712332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:55.848994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:55.857619 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f9d056d-763e-4f44-b220-32041b52ef87 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.159938 Sep 04 01:12:55.858275 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 329/651] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:55 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:56.882320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:56.882889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:56.890113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:56.890604 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:56.891045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:56.891736 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:56.892197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:56.892664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:57.024741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:57.033070 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ba3e0b5f-9f2c-409b-a3f9-a3b4eb15bea6 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.154674 Sep 04 01:12:57.033636 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 323/652] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:56 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:58.056197 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:58.056911 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:58.064131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:58.064653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:58.065100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:58.065785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:58.066239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:58.066666 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:58.197217 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:58.205571 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29d4d0fc-40f8-451c-9129-fad73be58f2c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.153171 Sep 04 01:12:58.206340 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 330/653] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:58 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:12:59.229314 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:12:59.229927 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:12:59.236948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:59.237432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:59.237870 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:59.238560 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:12:59.239018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:12:59.239447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:12:59.242088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:12:59.372347 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:12:59.380208 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fda2ad2f-8c01-430d-bc97-793d13c6480c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.154742 Sep 04 01:12:59.389104 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 324/654] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:12:59 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:00.404696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:00.405527 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:00.412096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:00.412636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:00.413069 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:00.413756 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:00.414200 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:00.414620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:00.551788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:00.559443 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d49fc29-f0ff-402a-a562-27b137cf3f0c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.158952 Sep 04 01:13:00.560318 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 331/655] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:00 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:01.583117 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:01.583768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:01.590010 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:01.590507 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:01.591819 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:01.591819 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:01.592208 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:01.592690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:01.734260 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:01.742041 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-68607cda-8a09-4e54-bb34-2595a0c6588c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.162947 Sep 04 01:13:01.742613 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 325/656] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:01 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:02.764570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:02.765196 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:02.771632 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:02.772102 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:02.772560 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:02.773236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:02.773685 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:02.774104 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:02.917185 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:02.923366 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-922d6235-845c-46d9-8d6b-016a6354b47c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.162600 Sep 04 01:13:02.923957 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 332/657] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:02 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:03.946441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:03.947075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:03.953556 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:03.954043 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:03.954482 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:03.955175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:03.955631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:03.956058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:04.087018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:04.094960 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b3734bca-23f8-4b92-a29b-0a1ea94daa4b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1511 microversion: 2.1 time: 0.152406 Sep 04 01:13:04.095532 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 326/658] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:03 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:04.117725 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:04.118484 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:04.120731 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:04.126029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:04.126516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:04.127009 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:04.127709 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:04.128183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:04.128640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:04.171564 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121099) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 01:13:04.438553 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4d90874-0645-4676-81c5-dd7e9190bbab tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "POST /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3/action" status: 202 len: 0 microversion: 2.1 time: 0.324646 Sep 04 01:13:04.442368 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 333/659] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:13:04 2022] POST /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:13:04.447447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:04.448313 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:04.454989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:04.455808 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:04.456250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:04.457065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:04.457899 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:04.458416 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:04.631124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:04.640167 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-766ea5ae-5396-4e8f-be79-c1f439994c42 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1519 microversion: 2.1 time: 0.196464 Sep 04 01:13:04.640810 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 327/660] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:04 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:05.663684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:05.664302 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:05.671048 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:05.671535 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:05.671975 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:05.672697 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:05.673158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:05.675300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:05.676140 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:05.808831 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:05.818158 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7418b9b-1cf6-495a-a544-d3c9ab4feca0 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1521 microversion: 2.1 time: 0.158581 Sep 04 01:13:05.819154 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 334/661] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:05 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:06.409512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "name": "network-vif-unplugged", "status": "completed", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:06.419315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:06.419735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:06.423785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:06.435359 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.compute.server_external_events [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] Unable to find a host for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3. Dropping event network-vif-unplugged {{(pid=121098) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 04 01:13:06.436848 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-cba2c4fe-85df-4f9c-bb54-cf43e53dbad6 req-5ae8874c-9d3f-48c9-9a03-70cd52ed20e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031153 Sep 04 01:13:06.437428 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 328/662] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 04 01:13:06.843982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:06.844618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:06.850992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:06.851478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:06.851926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:06.852650 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:06.853108 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:06.853538 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:06.982326 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:06.989472 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47fc5073-74c5-4b0d-88cf-3841a0dd0e6c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.150322 Sep 04 01:13:06.990067 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 335/663] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:06 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:08.015950 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:08.016674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:08.023167 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:08.023653 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:08.024090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:08.024810 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:08.025272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:08.025698 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:08.159433 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:08.167102 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d538a08c-6179-4f11-92ec-558dbed14904 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.155686 Sep 04 01:13:08.167671 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 329/664] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:08 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:09.190388 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:09.190995 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:09.197513 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:09.197990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:09.198418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:09.199100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:09.199546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:09.199967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:09.339247 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:09.347750 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84991b82-3d2e-4bca-8d2d-2c36ae7c7915 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.161394 Sep 04 01:13:09.351178 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 336/665] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:09 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:10.371457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:10.372101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:10.375229 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:10.380001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:10.380557 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:10.381004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:10.381705 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:10.382160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:10.382591 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:10.509618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:10.518348 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e48fa325-b359-4e95-bec1-b8e575af034c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.150716 Sep 04 01:13:10.518905 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 330/666] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:10 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:11.543147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:11.543920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:11.550811 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:11.551292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:11.551723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:11.552398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:11.552871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:11.553292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:11.686514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:11.694733 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dabfb7da-6bd5-473d-bb31-64c592ad2d00 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.155448 Sep 04 01:13:11.695301 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 337/667] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:11 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:12.719105 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:12.719862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:12.727000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:12.727748 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:12.728333 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:12.729314 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:12.729822 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:12.730201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:12.870965 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:12.878514 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-585f651a-1447-4586-80bb-e13e418013ae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.163843 Sep 04 01:13:12.879078 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 331/668] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:12 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:13.902046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:13.902655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:13.909916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:13.910399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:13.910833 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:13.911515 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:13.911977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:13.912403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:14.045049 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:14.053923 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a95dbcfe-6b89-4342-8790-dd391f9811cf tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.155714 Sep 04 01:13:14.054496 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 338/669] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:13 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:14.486346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "name": "network-vif-plugged", "status": "completed", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:14.495980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:14.496492 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:14.496904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:14.508220 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] Creating event network-vif-plugged:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:13:14.513777 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-97c42e60-f818-48fb-b9a3-6dbe4210d787 req-9a59148c-6735-4a50-9e70-31a02ca08d48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Sep 04 01:13:14.514756 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 332/670] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:15.076865 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:15.077612 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:15.084724 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:15.085293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:15.085737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:15.086417 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:15.086870 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:15.087292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:15.220687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:15.228382 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30153f2c-03a5-40d2-940d-e7a9b06525aa tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.155317 Sep 04 01:13:15.228984 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 339/671] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:15 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:16.254141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:16.254502 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:16.260866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:16.261342 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:16.261818 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:16.262562 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:16.263014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:16.263433 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:16.396186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:16.404194 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ee483387-16d8-4624-a55a-14ee2cafa3f2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1577 microversion: 2.1 time: 0.156160 Sep 04 01:13:16.405185 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 333/672] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:16 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:17.427362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:17.427967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:17.434282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:17.434755 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:17.435186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:17.435856 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:17.436305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:17.436751 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:17.566051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:17.573716 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2dad2469-4f23-4e77-96c6-54f619d7fd2b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1564 microversion: 2.1 time: 0.150264 Sep 04 01:13:17.574389 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 340/673] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:17 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:27.105143 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:27.105701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:27.108709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=7 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:27.109345 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=51 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:27.114657 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:27.115136 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:27.118425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:27.118425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:27.118425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:27.118425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:27.142616 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-68d96375-e528-4eb7-978c-e5f1485432a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.041379 Sep 04 01:13:27.143491 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 334/674] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:13:27 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:28.779228 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64a4078-19c1-496b-91da-a2434713b35a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:28.781654 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:28.783899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:28.785498 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=41 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:28.790161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:28.790644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:28.791075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:28.791760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:28.792208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:28.792653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:29.447775 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21efbca4-e942-4627-ac08-a890497f8396 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672486 Sep 04 01:13:29.448395 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 341/675] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:13:28 2022] POST /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:31.557100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1521175842", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "8de98734-02c6-441f-8701-947a041f89bd"}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:31.612742 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] validate_networks() for [('8de98734-02c6-441f-8701-947a041f89bd', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:13:31.700425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64a4078-19c1-496b-91da-a2434713b35a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:31.702844 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:31.710024 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:31.710549 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:31.711056 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:31.711908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:31.712431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:31.712892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:31.793741 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments HTTP/1.1 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 74 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:13:31.795490 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "b64a4078-19c1-496b-91da-a2434713b35a"}} Sep 04 01:13:31.796944 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'server_id': 'dc97e3ab-3fc3-4d50-991c-fc91c80b97e1', 'body': {'volumeAttachment': {'volumeId': 'b64a4078-19c1-496b-91da-a2434713b35a'}}} Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:31.797683 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:31.799102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 400 to user: Invalid volume: volume b64a4078-19c1-496b-91da-a2434713b35a is already attached to instances: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3342aa84-5022-4f9e-8276-99f4aebbb704 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101479 Sep 04 01:13:31.801022 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 342/676] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:13:31 2022] POST /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 04 01:13:31.868365 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:31.868885 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:31.875569 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:31.876144 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:31.876535 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:31.877233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:31.877685 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:31.878255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:31.964122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'services' on Instance uuid dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:32.024499 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:13:32.024981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:13:32.025457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:13:32.025867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:13:32.026280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:13:32.036266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:32.036781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:32.037222 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:32.037943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:32.038399 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:32.038826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:32.056140 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Getting quotas for project 2fe55a7032cb47ad98b86885aad23d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:13:32.060141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Getting quotas for user 48b714ce386c44c88914f5a74884a52a and project 2fe55a7032cb47ad98b86885aad23d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:13:32.071473 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:13:32.073922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:13:32.169938 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40aecd9b-3a78-48e9-877d-6ee029593e36 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments/b64a4078-19c1-496b-91da-a2434713b35a" status: 202 len: 0 microversion: 2.1 time: 0.303873 Sep 04 01:13:32.169938 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 343/677] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:13:31 2022] DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments/b64a4078-19c1-496b-91da-a2434713b35a => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 01:13:32.178803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:32.181082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:32.187620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:32.188218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:32.188692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:32.189393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:32.189851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:32.190282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:32.204501 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-07ac22ad-6cc4-4851-9c09-fd941ba3ce7c tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651608 Sep 04 01:13:32.205700 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 335/678] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:13:32.219203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7e200ef9-3484-4872-a5df-df33d68f0201 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:32.219473 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7e200ef9-3484-4872-a5df-df33d68f0201 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:32.226982 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00660a70-8f18-4ab2-aa5e-08ee2f2a7863 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053268 Sep 04 01:13:32.227653 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 344/679] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:13:32 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:13:32.288680 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7e200ef9-3484-4872-a5df-df33d68f0201 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:32.295246 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7e200ef9-3484-4872-a5df-df33d68f0201 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1214 microversion: 2.1 time: 0.081569 Sep 04 01:13:32.296019 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 336/680] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:32 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:33.239873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:33.242053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:33.248352 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:33.248860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:33.249291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:33.249960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:33.250408 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:33.250827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:33.280934 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f989586d-66a6-4423-bafd-09ea48b33cf0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Sep 04 01:13:33.281489 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 345/681] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:13:33 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:33.319775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:33.320751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:33.327049 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:33.327553 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:33.327971 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:33.328698 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:33.329145 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:33.329570 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:33.392307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:33.400158 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e1d71d84-81a9-44e3-a932-364040c76cd0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1218 microversion: 2.1 time: 0.085756 Sep 04 01:13:33.400751 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 337/682] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:33 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:34.293352 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:34.295542 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:34.302308 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.302806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.303263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.303949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.304403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.304850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.337184 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40f1eff7-9ce9-4298-80ff-e1505bbc68a0 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047597 Sep 04 01:13:34.338134 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 346/683] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:13:34 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:13:34.401497 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:34.401991 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:34.408513 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.409025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.409624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.410514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.411001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.416785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.423010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:34.423705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:34.430319 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.430877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.431389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.432144 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.432701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.433131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.437609 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:13:34.502013 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:34.510937 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f136332-d2db-4fe8-86cd-cc72c4157a67 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1274 microversion: 2.1 time: 0.091698 Sep 04 01:13:34.511871 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 347/684] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:34 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:34.745188 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f398bdc6-e474-42c6-98b9-f3066c617a05 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 204 len: 0 microversion: 2.1 time: 0.347160 Sep 04 01:13:34.745841 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 338/685] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:13:34 2022] DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:13:34.754843 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:34.755418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:34.761769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.762260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.762696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.763389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:34.763845 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:34.764275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:34.898538 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:34.906387 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c5336c1-933f-478d-b354-5706fa4b42fc tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1681 microversion: 2.1 time: 0.156183 Sep 04 01:13:34.906958 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 348/686] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:34 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:35.544956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:35.545665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:35.552259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:35.552783 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:35.553225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:35.553930 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:35.554369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:35.554801 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:35.695386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:35.703051 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ad222c9d-eea9-4979-a1d0-c8f5a82b22c2 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.162462 Sep 04 01:13:35.703623 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 339/687] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:35 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:35.931425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:35.931941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:35.938274 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:35.938751 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:35.939183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:35.939853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:35.941094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:35.941540 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:36.066051 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:36.073702 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ec8669b-754c-4689-9dac-321116a2532f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1681 microversion: 2.1 time: 0.146209 Sep 04 01:13:36.074267 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 349/688] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:35 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:36.728448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:36.729263 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:36.735706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:36.743131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:36.743131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:36.743131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:36.743131 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:36.743828 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:36.910329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:36.918139 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-eec94466-ecc7-43a0-a9ea-f64c3e4010e1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.193542 Sep 04 01:13:36.918786 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 340/689] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:36 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:36.937437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b8613b-9631-49b3-b8b8-2f03c3d55129", "tag": "8a09f235-8e36-4515-9f29-c2eb58373ec3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:36.949003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:36.949492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:36.949928 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:36.963316 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] Creating event network-changed:8a09f235-8e36-4515-9f29-c2eb58373ec3 for instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 on hv-cinder-maste Sep 04 01:13:36.968910 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5c1c956c-9701-4466-a403-7d3433d43e33 req-50a4e0ee-8ac8-4c11-92cc-45b80293cd7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043820 Sep 04 01:13:36.969517 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 350/690] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:37.097190 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:37.097905 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:37.103889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:37.104697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:37.105135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:37.105828 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:37.106277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:37.106852 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:37.409691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:37.419526 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6801bf0e-1085-4b80-8d59-173beddcee01 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1681 microversion: 2.1 time: 0.326335 Sep 04 01:13:37.420772 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 341/691] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:37 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:37.818063 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc97e3ab-3fc3-4d50-991c-fc91c80b97e1", "name": "network-vif-deleted", "tag": "5440d337-e806-4dac-94e1-00febf7b2d00"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:37.827921 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:37.833297 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:37.833297 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:37.840781 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] Creating event network-vif-deleted:5440d337-e806-4dac-94e1-00febf7b2d00 for instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 on hv-cinder-maste Sep 04 01:13:37.845920 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-af631b8b-0970-4d7b-9a33-7ef6ff885664 req-95954856-1bf9-437d-acf1-d45e7f146cf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032403 Sep 04 01:13:37.846524 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 351/692] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:37.946124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:37.946842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:37.967722 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:37.968240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:37.968750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:37.969475 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:37.969956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:37.970387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:38.122206 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:38.130771 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d0edbf00-bd0f-452d-9362-c0ab679320d9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.192665 Sep 04 01:13:38.131344 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 342/693] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:37 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:38.446069 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:38.446783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:38.453206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:38.453693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:38.454835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:38.455526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:38.456339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:38.456793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:38.490100 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:38.490584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:38.491109 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:38.491556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:38.535227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:38.543356 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-008f7fb4-2c32-489a-9899-11e1fa77c151 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1331 microversion: 2.1 time: 0.102868 Sep 04 01:13:38.543935 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 352/694] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:38 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:39.154563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:39.155113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:39.162166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:39.162643 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:39.163065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:39.163747 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:39.164200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:39.164659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:39.296043 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:39.303955 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-05a2196c-d159-4ae3-9de1-f45adc952964 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.153481 Sep 04 01:13:39.304544 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 343/695] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:39 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:39.568339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:39.569102 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:39.575411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:39.575917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:39.576354 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:39.577071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:39.577532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:39.577956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:39.608720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:39.609201 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:39.609634 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:39.610076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:39.653414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:39.661046 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0cb692df-936d-4eec-803b-450e083baef6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1331 microversion: 2.1 time: 0.097285 Sep 04 01:13:39.661608 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 353/696] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:39 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:40.327313 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:40.328275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:40.334977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:40.335465 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:40.335907 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:40.336638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:40.337097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:40.337530 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:40.468138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:40.476668 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-11bea4e3-ab0c-46bc-aa33-737df4839ec9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.153241 Sep 04 01:13:40.477220 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 344/697] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:40 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:40.683152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:40.683768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:40.690134 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:40.690662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:40.691105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:40.695205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:40.695205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:40.695205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:40.726027 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:40.726507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:40.726949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:40.727393 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:40.768078 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:40.776896 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac96055a-2363-4af8-8aa5-ab6f33b17f47 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 200 len: 1331 microversion: 2.1 time: 0.097598 Sep 04 01:13:40.777491 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 354/698] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:40 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:41.500077 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:41.500721 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:41.507806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:41.508288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:41.508755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:41.509444 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:41.510166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:41.510593 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:41.639776 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:41.647553 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-227c5b36-205d-439a-ada5-c982cded4098 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.151350 Sep 04 01:13:41.648172 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 345/699] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:41 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:41.801504 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:41.802031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:41.808367 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:41.808886 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:41.809323 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:41.810007 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:41.810461 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:41.810884 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:41.824144 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 HTTP/1.1 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:13:41.825789 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:13:41.827347 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'dc97e3ab-3fc3-4d50-991c-fc91c80b97e1'} Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:13:41.828180 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:13:41.829743 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:13:41.831176 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:13:41.831176 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a850f53-ed7d-4366-ba85-27f668c1b37a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 404 len: 111 microversion: 2.1 time: 0.030874 Sep 04 01:13:41.831176 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 355/700] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:41 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:13:41.836882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d540ac42-0471-426d-be2b-5f112296c7b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '.version_select at 0x7fba2495ff70>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:42.026054 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d540ac42-0471-426d-be2b-5f112296c7b5 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443764654" status: 202 len: 0 microversion: 2.1 time: 0.193784 Sep 04 01:13:42.026639 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 346/701] 10.222.0.27 () {58 vars in 1218 bytes} [Sun Sep 4 01:13:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443764654 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 01:13:42.676191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:42.678684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:42.684926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:42.685622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:42.686233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:42.686932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:42.687546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:42.687971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:42.709519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:42.781564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8cfb9daf-1628-460f-9228-8d9ed3c61d5c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: .version_select at 0x7fba24a5b790>, body: {"keypair": {"name": "tempest-keypair-799039288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyev8zDaSKoNHV3o2pwusoGPpKJlDySHWBIVSZc7BTaIbrs/mfZpCbus6WZ/rEcEP0HdeBePDxAXAepC7WnuFHDm/kg8fZGk4tCU9pgYG2mXePKurbYOQdEVEHRAbCPxA=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:42.788953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:42.789893 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=8 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:42.803664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-8cfb9daf-1628-460f-9228-8d9ed3c61d5c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:13:42.807827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-8cfb9daf-1628-460f-9228-8d9ed3c61d5c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:13:42.850501 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:42.858488 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb89227e-968b-4a9e-918d-defed9525f49 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.191802 Sep 04 01:13:42.858985 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 356/702] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:42 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:42.878663 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8cfb9daf-1628-460f-9228-8d9ed3c61d5c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100439 Sep 04 01:13:42.879306 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 347/703] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:13:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:13:43.882462 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:43.885396 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:43.890366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:43.890845 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:43.891279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:43.891961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:43.892416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:43.892873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:44.358809 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:44.367371 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d652b3d-23de-4582-8bff-413d77afc2bf tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.490018 Sep 04 01:13:44.367947 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 357/704] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:43 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:44.872122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b8613b-9631-49b3-b8b8-2f03c3d55129", "name": "network-vif-plugged", "status": "completed", "tag": "8a09f235-8e36-4515-9f29-c2eb58373ec3"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:44.883761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:44.884270 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:44.884750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:44.895907 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] Creating event network-vif-plugged:8a09f235-8e36-4515-9f29-c2eb58373ec3 for instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 on hv-cinder-maste Sep 04 01:13:44.901039 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-58a282e3-f20a-4a6b-9a48-98497c781a54 req-9ea21cfd-f117-4f73-a3b8-cfc1c8aa0a1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Sep 04 01:13:44.901905 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 348/705] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:45.277704 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1549927898", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b20c706-eedb-40a9-af04-eb1e93ffe3a6"}], "security_groups": [{"name": "tempest-securitygroup--1822243973"}], "key_name": "tempest-keypair-799039288", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:45.385675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] validate_networks() for [('2b20c706-eedb-40a9-af04-eb1e93ffe3a6', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:13:45.390701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:45.391511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:45.398098 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:45.398585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:45.399024 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:45.399723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:45.400179 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:45.400637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:45.531221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:45.539373 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ae9fe909-7e8d-479f-8e47-102acf008b53 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.152762 Sep 04 01:13:45.539944 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 349/706] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:45 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:45.752497 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:13:45.752979 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:13:45.753444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:13:45.753853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:13:45.754270 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:13:45.763240 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:45.763715 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:45.764149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:45.764902 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:45.765356 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:45.765780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:45.782494 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:13:45.787065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Getting quotas for user 0c5e9731f6204b44841b8524762d5a77 and project ef5de4321f9c4687a0bae83183b59a39. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:13:45.797753 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:13:45.800011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:13:45.940343 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f5b50ec-7b53-45d9-b47e-cb977c6f398b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666924 Sep 04 01:13:45.941115 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 358/707] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:13:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:13:45.951974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a45a8ea3-95a2-4c7d-a0c5-3c0dd346f9e3 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:45.952640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a45a8ea3-95a2-4c7d-a0c5-3c0dd346f9e3 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:46.005252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-a45a8ea3-95a2-4c7d-a0c5-3c0dd346f9e3 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:46.012795 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a45a8ea3-95a2-4c7d-a0c5-3c0dd346f9e3 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1241 microversion: 2.1 time: 0.064573 Sep 04 01:13:46.013365 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 350/708] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:45 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:46.563187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:46.563723 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:46.571307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:46.571790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:46.572219 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:46.572931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:46.573384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:46.573804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:46.703364 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:46.711287 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96a16d25-29be-427a-a139-5785e7d502f0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1314 microversion: 2.1 time: 0.152724 Sep 04 01:13:46.711842 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 359/709] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:46 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:47.035515 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:47.036125 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:47.042990 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:47.043467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:47.043898 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:47.044620 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:47.045061 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:47.045511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:47.108051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:47.116121 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-264c92a3-e9c2-475f-9f56-84eea94b8386 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1245 microversion: 2.1 time: 0.084882 Sep 04 01:13:47.116721 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 351/710] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:47 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:47.734227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:47.734799 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:47.743837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:47.746294 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:47.746294 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:47.746510 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:47.747251 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:47.747966 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:47.885807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:47.894037 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a4c91d9-71bf-402e-ab72-d4e92f4b4759 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1499 microversion: 2.1 time: 0.163956 Sep 04 01:13:47.895293 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 360/711] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:47 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:48.138397 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:48.139014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:48.145351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:48.145831 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:48.146571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:48.146936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:48.147390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:48.147817 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:48.209855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:48.218074 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5aceccf5-254b-4448-bfa1-b46054e26841 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1293 microversion: 2.1 time: 0.083754 Sep 04 01:13:48.218854 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 352/712] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:48 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:48.733346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:48.733835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:48.740529 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:48.745152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:48.745152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:48.745152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:48.745152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:48.745516 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:48.773295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:13:49.042286 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63fc7a75-3b77-435f-be8d-7d4a2b37badb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 204 len: 0 microversion: 2.1 time: 0.312440 Sep 04 01:13:49.042884 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 361/713] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:13:48 2022] DELETE /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:13:49.051863 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:49.052594 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:49.058903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:49.059431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:49.059873 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:49.060618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:49.061134 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:49.061564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:49.242525 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:49.243263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:49.249501 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:49.249951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:49.250388 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:49.251081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:49.251542 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:49.251985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:49.318913 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:49.327005 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c926553a-9e31-472f-92dd-0a03625ec177 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1299 microversion: 2.1 time: 0.089019 Sep 04 01:13:49.327590 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 362/714] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:49 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:49.368820 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:49.376788 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-31344b77-ad43-4c1c-a2d4-416667b531ad tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1505 microversion: 2.1 time: 0.329268 Sep 04 01:13:49.380784 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 353/715] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:49 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:50.351652 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:50.352257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:50.358650 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:50.359127 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:50.359558 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:50.360230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:50.360705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:50.361123 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:50.401608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:50.402293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:50.408943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:50.409441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:50.410506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:50.411663 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:50.412126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:50.412581 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:50.434911 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:50.495068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:50.502923 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-935065ad-82ec-4dc3-be8c-6b2aa1d592a6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.155701 Sep 04 01:13:50.505336 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 363/716] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:50 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:50.619545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:50.627293 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-85976cbe-9d30-4a5b-818d-3141ef2bea44 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1505 microversion: 2.1 time: 0.229851 Sep 04 01:13:50.627864 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 354/717] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:50 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:50.927853 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1128769e-8203-4356-8951-9dcc9357e608", "tag": "07128323-5e76-4c1e-8df0-e3517fcb84f6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:50.937454 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:50.937920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:50.938341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:50.950027 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] Creating event network-changed:07128323-5e76-4c1e-8df0-e3517fcb84f6 for instance 1128769e-8203-4356-8951-9dcc9357e608 on hv-cinder-maste Sep 04 01:13:50.954989 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-feea420e-8c22-46a3-b567-f0b8f97dc7af req-bffe266b-2970-47d8-8120-941bcdc76106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031091 Sep 04 01:13:50.955432 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 364/718] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:51.468713 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b8613b-9631-49b3-b8b8-2f03c3d55129", "name": "network-vif-deleted", "tag": "8a09f235-8e36-4515-9f29-c2eb58373ec3"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:51.480336 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:51.480853 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:51.485631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:51.492984 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] Creating event network-vif-deleted:8a09f235-8e36-4515-9f29-c2eb58373ec3 for instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 on hv-cinder-maste Sep 04 01:13:51.498156 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-0e2d7c0f-d1b3-4d3e-a226-5b86419c0e67 req-5badcee2-6e2a-4275-ad1b-f42bf176fb30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Sep 04 01:13:51.498897 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 355/719] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:51.529894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:51.535387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:51.537315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:51.537796 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:51.538222 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:51.538973 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:51.539419 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:51.539841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:51.653897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:51.655580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:51.664728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:51.665487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:51.666074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:51.667050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:51.668344 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:51.668948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:51.678774 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:51.687664 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80628b05-9ea1-45ef-9cf7-4f38b4d2482a tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.163461 Sep 04 01:13:51.700725 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 365/720] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:51 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:51.744525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:51.752329 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e73be080-2cac-489c-bbcd-a299030ad03a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1299 microversion: 2.1 time: 0.104631 Sep 04 01:13:51.752948 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 356/721] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:51 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:52.711068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:52.711681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:52.718174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:52.718656 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:52.719093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:52.719772 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:52.720226 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:52.720687 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:52.775667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:52.776284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:52.782674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:52.783185 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:52.783628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:52.784320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:52.785295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:52.785922 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:52.816915 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:52.817427 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:52.817862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:52.818304 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lazy-loading 'fault' on Instance uuid a0b8613b-9631-49b3-b8b8-2f03c3d55129 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:52.853003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:52.860991 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4e8facb-d849-4d9c-87db-8c88bf434452 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.154015 Sep 04 01:13:52.861391 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 366/722] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:52 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:52.863587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:52.871380 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6e8f962d-4256-4990-a8ba-3868d7544aa6 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1304 microversion: 2.1 time: 0.099764 Sep 04 01:13:52.871925 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 357/723] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:52 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:53.883573 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:53.884208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:53.890980 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:53.891456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:53.891888 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:53.892593 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:53.893044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:53.893464 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:53.894059 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:53.895380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:53.902410 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:53.902891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:53.903329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:53.904025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:53.904539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:53.904970 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:53.936283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:53.936800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:53.937238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:53.937681 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lazy-loading 'fault' on Instance uuid a0b8613b-9631-49b3-b8b8-2f03c3d55129 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:13:53.977153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:53.984791 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d164ad86-891a-40a9-96aa-62e797a165f4 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 200 len: 1304 microversion: 2.1 time: 0.094451 Sep 04 01:13:53.985523 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 358/724] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:53 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:13:54.024479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:54.032059 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68afff74-6636-4742-98ce-f783bb7051e4 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.152365 Sep 04 01:13:54.032658 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 367/725] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:53 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:55.007087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:55.011272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a0b8613b-9631-49b3-b8b8-2f03c3d55129] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:55.014329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.014808 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.015238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.015916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.016366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.016817 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.030218 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] HTTP exception thrown: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Request method failure captured: Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 HTTP/1.1 Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_u5_18HjQuLGjXeZpImjQwMwn_HJ8hYg3tC0c8pL9SU3gWyVjTA3MKe5bcGplMWHbnC4aisex_AWYSH609e2TVULyEk0ZIFkDkozpaRh_TvPyPqrZtT9V8MngTs__e4hIl0qMzh48jdcP4QQj_GuRR3bysqCCcmjgmo9snyrE9CWmM Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 2fe55a7032cb47ad98b86885aad23d6c Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesActionsTest-720601223 Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:13:55.031830 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe55a7032cb47ad98b86885aad23d6c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesActionsTest-720601223 Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 2fe55a7032cb47ad98b86885aad23d6c Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesActionsTest-720601223 Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesActionsTest-720601223-project Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 48b714ce386c44c88914f5a74884a52a Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesActionsTest-720601223-project Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. Sep 04 01:13:55.040610 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'a0b8613b-9631-49b3-b8b8-2f03c3d55129'} Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:13:55.041445 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. Sep 04 01:13:55.042715 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:13:55.043867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Returning 404 to user: Instance a0b8613b-9631-49b3-b8b8-2f03c3d55129 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:13:55.043867 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-479f39ef-f778-4186-93c9-433cef1648cc tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129" status: 404 len: 111 microversion: 2.1 time: 0.030005 Sep 04 01:13:55.043867 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 359/726] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:55 2022] GET /compute/v2.1/servers/a0b8613b-9631-49b3-b8b8-2f03c3d55129 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:13:55.054750 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:55.055444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:55.061873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.062346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.066765 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.066765 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.066765 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.066765 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.085888 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-8800611", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "networks": [{"uuid": "8de98734-02c6-441f-8701-947a041f89bd"}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:55.139855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] validate_networks() for [('8de98734-02c6-441f-8701-947a041f89bd', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:13:55.196767 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:55.204488 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23a8d10d-11cf-4685-94dc-b0715f26bfc2 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.153614 Sep 04 01:13:55.205048 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 368/727] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:55 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:55.485049 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:13:55.485473 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:13:55.485972 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:13:55.486380 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:13:55.486789 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:13:55.495838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.496315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.496787 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.497506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:55.497962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:55.498404 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:55.515385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Getting quotas for project 2fe55a7032cb47ad98b86885aad23d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:13:55.517500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:55.519921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Getting quotas for user 48b714ce386c44c88914f5a74884a52a and project 2fe55a7032cb47ad98b86885aad23d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:13:55.530532 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:13:55.532791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:13:55.627061 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a779134b-c8d9-4dc3-bd84-8b9c19645875 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545668 Sep 04 01:13:55.627707 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 360/728] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:13:55.639631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78cae48e-2b82-41e8-8e63-b969dcbc4f3d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:55.640377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78cae48e-2b82-41e8-8e63-b969dcbc4f3d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:55.696119 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-78cae48e-2b82-41e8-8e63-b969dcbc4f3d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:55.703517 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78cae48e-2b82-41e8-8e63-b969dcbc4f3d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1211 microversion: 2.1 time: 0.067890 Sep 04 01:13:55.704284 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 369/729] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:55 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1211 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:56.228765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:56.233146 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:56.236166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:56.236674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:56.237151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:56.237844 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:56.238297 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:56.238726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:56.368123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:56.376830 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1c5d49be-1590-4506-a08f-3beb79d1cee6 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.152514 Sep 04 01:13:56.377412 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 361/730] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:56 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:56.726986 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:56.727625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:56.729693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:56.735540 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:56.736242 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:56.740830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:56.740830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:56.740830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:56.740830 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:56.801909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:56.809408 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86d08a5c-dba8-42e4-b3d3-4312c65de95a tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1215 microversion: 2.1 time: 0.087073 Sep 04 01:13:56.809965 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 370/731] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:56 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:57.401129 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:57.401675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:57.408468 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:57.410177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:57.410177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:57.410621 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:57.411083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:57.411523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:57.548855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:57.558299 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ecfb235a-cb80-4a2e-bd3b-a7c7ed817440 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.161097 Sep 04 01:13:57.558872 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 362/732] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:57 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:57.833802 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:57.834700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:57.841487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:57.842034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:57.845557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:57.845557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:57.845557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:57.845557 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:57.906863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:57.915044 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af4c4498-d7c9-4c79-bb88-25c32a759fc0 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1271 microversion: 2.1 time: 0.086372 Sep 04 01:13:57.915615 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 371/733] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:57 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:58.581228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:58.582363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:58.589091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:58.589733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:58.590256 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:58.591196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:58.591726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:58.592387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:58.768967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1128769e-8203-4356-8951-9dcc9357e608", "name": "network-vif-plugged", "status": "completed", "tag": "07128323-5e76-4c1e-8df0-e3517fcb84f6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:58.779702 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:58.780177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:58.780634 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:58.792642 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] Creating event network-vif-plugged:07128323-5e76-4c1e-8df0-e3517fcb84f6 for instance 1128769e-8203-4356-8951-9dcc9357e608 on hv-cinder-maste Sep 04 01:13:58.797656 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f21c285c-9185-4c30-81b7-29287058cb88 req-4874fe04-c633-4de6-8793-366b9340acef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Sep 04 01:13:58.798366 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 372/734] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:13:58.835439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:58.843681 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b64c36ec-50a7-45ab-b75d-840c7c976176 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.266435 Sep 04 01:13:58.844718 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 363/735] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:58 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:58.940620 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:58.941914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:58.948769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:58.949497 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:58.949942 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:58.950637 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:58.951096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:58.951555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:59.090901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:13:59.099537 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-185c3868-67de-4029-94cb-10bc4a5c897e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.163174 Sep 04 01:13:59.112484 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 373/736] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:58 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:13:59.275757 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a876c4e7-566f-4e4c-8f02-81a61f8cfcce", "tag": "6e3169ff-9515-4597-9d16-02a3e59d7e4d"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:13:59.286920 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:59.287413 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:59.287851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:59.300218 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] Creating event network-changed:6e3169ff-9515-4597-9d16-02a3e59d7e4d for instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce on hv-cinder-maste Sep 04 01:13:59.307042 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-89ddc554-a2d1-4cfd-80ab-996ed9929bda req-d9f27eb9-38ba-48f6-b16f-6accfd7dc094 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035136 Sep 04 01:13:59.309889 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 364/737] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:13:59.867045 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:13:59.867681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:13:59.869653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:13:59.874526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:59.874742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:59.875182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:59.875860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:13:59.876315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:13:59.876764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:13:59.897234 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:00.007701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:00.015577 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dd6a47b-4372-4240-9791-224f5d515462 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1367 microversion: 2.1 time: 0.152507 Sep 04 01:14:00.016179 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:13:59 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:00.123687 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:00.124387 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:00.131123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:00.131591 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:00.132027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:00.132731 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:00.133182 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:00.133602 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:00.331052 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:00.334339 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:00.334714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:00.340233 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-87b737e8-35ac-482e-8458-90104e50cefd tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.221121 Sep 04 01:14:00.340866 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 365/739] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:00 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:00.341362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:00.342054 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:00.342667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:00.343365 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:00.343818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:00.344242 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:00.368883 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5640b337-fa7d-47f3-815d-ab48e40be627 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/ips" status: 200 len: 149 microversion: 2.20 time: 0.039723 Sep 04 01:14:00.371960 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 375/740] 10.222.0.27 () {60 vars in 1289 bytes} [Sun Sep 4 01:14:00 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 01:14:01.038613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:01.039223 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:01.045074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.045807 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.046234 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.046957 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.047411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.047837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.238588 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:01.247370 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0c44782d-8e5c-4914-9a9c-929597d8c0c8 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1557 microversion: 2.1 time: 0.212850 Sep 04 01:14:01.247951 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 366/741] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:01 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:01.270287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:01.270882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:01.277375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.277850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.278285 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.278965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.279444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.280057 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.365976 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-030f6453-0114-4092-af96-45318567aa72 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096488 Sep 04 01:14:01.366097 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:01.366207 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 376/742] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:14:01 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:01.366318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:01.371614 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.372237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.372724 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.373420 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:01.373890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:01.374437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:01.558351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:01.566122 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3b0ed0c8-98fe-4c9f-9fbc-15c22cd95c8f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.206762 Sep 04 01:14:01.566810 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 367/743] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:01 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:02.318738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1128769e-8203-4356-8951-9dcc9357e608", "tag": "07128323-5e76-4c1e-8df0-e3517fcb84f6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:02.328213 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.328719 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.329150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.341383 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] Creating event network-changed:07128323-5e76-4c1e-8df0-e3517fcb84f6 for instance 1128769e-8203-4356-8951-9dcc9357e608 on hv-cinder-maste Sep 04 01:14:02.346879 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-857ae9fa-3894-41a2-aa00-54d7f35840db req-2b3c6304-fec6-4acc-8daa-62c544598190 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Sep 04 01:14:02.347583 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 377/744] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:02.479614 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:02.480189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:02.486963 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.487450 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.488031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.488948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.489688 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.490284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.514734 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lazy-loading 'flavor' on Instance uuid a6e5adfb-a39d-477a-a549-cb72299066a4 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:14:02.590611 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:02.591293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:02.598267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.598783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.599218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.600079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.600437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.600893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.738722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:02.746742 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-644e69a6-8339-42e7-a240-bcb79b06aaa9 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.160583 Sep 04 01:14:02.747321 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 378/745] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:02 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:02.933158 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-543d3f24-de59-49aa-a75c-a0e20dce3348 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/action" status: 202 len: 0 microversion: 2.20 time: 0.457950 Sep 04 01:14:02.933898 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 368/746] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Sep 4 01:14:02 2022] POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:14:02.942675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:02.943369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:02.949874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.950383 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.950812 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:02.951486 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:02.951931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:02.952375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:03.083559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:03.092266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:03.093762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:03.094909 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb810c42-9acd-4756-90b2-e478e8e8a2dd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.156101 Sep 04 01:14:03.095458 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 379/747] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:02 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:03.772392 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:03.773156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:03.779367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:03.779854 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:03.780292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:03.781014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:03.781471 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:03.781900 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:03.911618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:03.919431 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9027464c-5ab5-4cbf-8f79-1b51ff239d2d tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.152221 Sep 04 01:14:03.919998 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 369/748] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:03 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:04.120237 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:04.120882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:04.127425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:04.127910 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:04.128348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:04.129068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:04.129528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:04.129957 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:04.268300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:04.276672 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:04.278179 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:04.279339 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2230242f-8821-4352-bce1-68ab7055940d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.163762 Sep 04 01:14:04.279935 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 380/749] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:04 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:04.942238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:04.942847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:04.949210 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:04.949688 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:04.950120 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:04.950796 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:04.951247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:04.951670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:05.077773 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:05.086050 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-df522879-2690-4da6-be6a-1d9ada67fc43 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.147724 Sep 04 01:14:05.086611 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 370/750] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:04 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:05.306164 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:05.306768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:05.313186 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:05.313668 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:05.314104 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:05.314782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:05.315241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:05.315663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:05.441266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:05.449885 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:05.451325 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:05.452502 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0a4c2c1-c480-4a01-bf9c-541ab5dc8a8f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.150897 Sep 04 01:14:05.453062 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 381/751] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:05 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:06.109391 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:06.110003 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:06.111910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:06.112577 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=12 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:06.118510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:06.118988 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:06.119419 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:06.120247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:06.120733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:06.121159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:06.125047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:06.254293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:06.268371 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-57fe9a53-2d46-4df3-bb25-4df9515fa30f tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.162749 Sep 04 01:14:06.268995 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 371/752] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:06 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:06.478313 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:06.478917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:06.480913 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:06.486018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:06.486496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:06.486934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:06.487652 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:06.488105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:06.488584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:06.615096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:06.624093 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:06.625566 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:06.626899 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95f47ea7-ec19-41b4-b8d8-a5a21641c088 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.152836 Sep 04 01:14:06.627469 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 382/753] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:06 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:07.291567 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:07.292163 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:07.299568 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:07.300142 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:07.300675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:07.301432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:07.301992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:07.302496 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:07.433462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:07.442181 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3547ff22-c40e-4880-9e64-d07bcef8b9d7 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.155144 Sep 04 01:14:07.442710 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 372/754] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:07 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:07.652403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:07.653034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:07.659381 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:07.659866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:07.660307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:07.661025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:07.661487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:07.661915 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:07.794647 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:07.802555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:07.804829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:07.805987 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61fb8b91-466c-47bc-bcd1-9a55539396a0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.157512 Sep 04 01:14:07.806550 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 383/755] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:07 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:08.464900 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:08.465543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:08.472055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:08.472561 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:08.472994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:08.473667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:08.474228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:08.475145 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:08.603219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:08.610780 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-bac0fede-1de5-4efe-9bed-cc3f7b09ec12 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.149983 Sep 04 01:14:08.611353 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 373/756] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:08 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:08.811012 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a876c4e7-566f-4e4c-8f02-81a61f8cfcce", "name": "network-vif-plugged", "status": "completed", "tag": "6e3169ff-9515-4597-9d16-02a3e59d7e4d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:08.821548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:08.822029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:08.822493 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:08.830868 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:08.831520 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:08.833744 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] Creating event network-vif-plugged:6e3169ff-9515-4597-9d16-02a3e59d7e4d for instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce on hv-cinder-maste Sep 04 01:14:08.838373 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:08.838948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:08.839329 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f3ac86fe-b2f8-4f4d-b90c-a2888c202c56 req-a1e4dc4f-f253-442a-a9db-223deb2c5ac3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 Sep 04 01:14:08.846210 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:08.846721 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 384/757] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:08.846830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:08.846830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:08.846830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:08.975864 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:08.983954 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:08.985417 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:08.986629 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b09148d4-3fe1-46a5-a148-fae437cf8758 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.159652 Sep 04 01:14:08.987190 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 374/758] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:08 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:09.635255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:09.635977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:09.642081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:09.642559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:09.642998 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:09.643669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:09.644120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:09.644569 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:09.773101 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:09.780708 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d930a72-3aee-4d77-bbb0-ea6c6cd091cb tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.149963 Sep 04 01:14:09.781277 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 385/759] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:09 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:10.013449 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:10.014075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:10.020547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:10.021039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:10.022135 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:10.022999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:10.023462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:10.023897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:10.150385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:10.158356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:10.159795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:10.160979 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dd88c9a1-1a4d-447f-b7ee-f79d21264cc6 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.151742 Sep 04 01:14:10.161546 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 375/760] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:10 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:10.803939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:10.804584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:10.811323 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:10.811875 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:10.812307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:10.813172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:10.813625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:10.814120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:10.943177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:10.951219 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86d2a39e-fcdf-4a40-a289-e193a795c951 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1311 microversion: 2.1 time: 0.151555 Sep 04 01:14:10.951812 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 386/761] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:10 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:11.187197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:11.187716 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:11.194738 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:11.195217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:11.195651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:11.196346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:11.196827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:11.197256 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:11.326706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:11.335426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:11.336902 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:11.338069 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-92996e8e-7a30-4627-bc5f-d77528d4d8c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.154840 Sep 04 01:14:11.338633 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 376/762] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:11 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:11.974002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:11.974627 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:11.981279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:11.981759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:11.982190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:11.982864 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:11.983314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:11.983737 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:12.110145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:12.118251 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db700615-f53f-4130-b384-7f31641e44c1 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1495 microversion: 2.1 time: 0.148100 Sep 04 01:14:12.118819 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 387/763] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:11 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1495 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:12.369825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:12.370438 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:12.376879 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:12.377355 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:12.377788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:12.378475 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:12.378935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:12.379357 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:12.528099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:12.536852 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:12.538332 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:12.539484 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4733304c-2af7-4b12-97e3-d34f087903a9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.173696 Sep 04 01:14:12.540384 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 377/764] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:12 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:12.926682 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:12.927179 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:12.933554 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:12.934039 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:12.934471 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:12.935151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:12.935603 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:12.936030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:12.961259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:14:13.225393 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ef55035-afd7-4646-a91f-c7ce53d2d151 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 204 len: 0 microversion: 2.1 time: 0.302262 Sep 04 01:14:13.226009 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 388/765] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:14:12 2022] DELETE /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:14:13.234944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:13.235558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:13.242076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:13.242560 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:13.242996 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:13.243679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:13.244143 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:13.244606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:13.374259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:13.383293 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-58b2c702-51a5-4011-a54d-ad53980da4de tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1501 microversion: 2.1 time: 0.152328 Sep 04 01:14:13.383866 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 378/766] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:13 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:13.566973 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:13.567665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:13.573716 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:13.574191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:13.574622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:13.575292 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:13.575736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:13.576153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:13.701872 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:13.710825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:13.712267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:13.713435 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af7ea470-6f88-418f-bc1b-cb5c38e829ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.150734 Sep 04 01:14:13.713994 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 389/767] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:13 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:14.406843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:14.407457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:14.414581 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:14.415101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:14.415571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:14.416276 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:14.416754 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:14.417172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:14.739862 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:14.740694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:14.747501 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:14.748053 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:14.748519 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:14.749223 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:14.749683 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:14.750111 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:14.789733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:14.797527 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4b557fe5-7e60-4688-bdef-2e3801c2c76e tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1501 microversion: 2.1 time: 0.394665 Sep 04 01:14:14.798097 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 379/768] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:14 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1501 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:14.889113 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:14.897539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:14.898982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:14.900158 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43a79add-a576-427a-8a85-91e3260245bc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.164287 Sep 04 01:14:14.900781 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 390/769] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:14 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:15.815326 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a876c4e7-566f-4e4c-8f02-81a61f8cfcce", "name": "network-vif-deleted", "tag": "6e3169ff-9515-4597-9d16-02a3e59d7e4d"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:15.822248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:15.823019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:15.826593 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:15.827074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:15.827512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:15.829442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:15.833878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:15.833878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:15.833878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:15.833878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:15.834341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:15.840553 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] Creating event network-vif-deleted:6e3169ff-9515-4597-9d16-02a3e59d7e4d for instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce on hv-cinder-maste Sep 04 01:14:15.846433 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-a1145322-a2d9-45a2-bed3-ce826dc8f811 req-e991ecbb-edea-4613-a1c6-87314fb036b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035301 Sep 04 01:14:15.847037 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 380/770] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:15.854057 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:15.898359 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:15.906497 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96258e50-df8f-4f89-be26-716ea074cb29 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1459 microversion: 2.1 time: 0.088750 Sep 04 01:14:15.907068 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 391/771] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:15 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1459 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:15.926219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:15.926914 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:15.934561 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:15.935047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:15.935482 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:15.936172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:15.936649 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:15.937073 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:16.073763 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:16.082116 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:16.083554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:16.084860 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f7ca0144-d518-4c3a-8c60-6116870b9a8c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.163082 Sep 04 01:14:16.085467 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 381/772] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:15 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:16.930591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:16.931187 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:16.938016 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:16.938488 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:16.938916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:16.939586 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:16.940105 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:16.940449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:16.970738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:16.971208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:16.971641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:16.972071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lazy-loading 'fault' on Instance uuid a876c4e7-566f-4e4c-8f02-81a61f8cfcce {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:14:17.014769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b714ce386c44c88914f5a74884a52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe55a7032cb47ad98b86885aad23d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:17.021454 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fefda3bd-c530-43c2-9bbf-93f20e613984 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 200 len: 1301 microversion: 2.1 time: 0.095493 Sep 04 01:14:17.022023 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 392/773] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:16 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:17.110325 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:17.110954 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:17.117470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:17.117948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:17.118383 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:17.119065 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:17.119527 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:17.120247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:17.246022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:17.254043 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:17.255483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:17.256733 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-05098d4b-f399-4258-9d7f-5a74435a7ff5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.150208 Sep 04 01:14:17.257298 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 382/774] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:17 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:18.045606 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:18.046216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] [instance: a876c4e7-566f-4e4c-8f02-81a61f8cfcce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:18.052752 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:18.053236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:18.053672 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:18.054351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:18.054810 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:18.056174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:18.069266 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] HTTP exception thrown: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Request method failure captured: Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce HTTP/1.1 Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_u5_18HjQuLGjXeZpImjQwMwn_HJ8hYg3tC0c8pL9SU3gWyVjTA3MKe5bcGplMWHbnC4aisex_AWYSH609e2TVULyEk0ZIFkDkozpaRh_TvPyPqrZtT9V8MngTs__e4hIl0qMzh48jdcP4QQj_GuRR3bysqCCcmjgmo9snyrE9CWmM Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 2fe55a7032cb47ad98b86885aad23d6c Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesActionsTest-720601223 Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:14:18.071585 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe55a7032cb47ad98b86885aad23d6c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe55a7032cb47ad98b86885aad23d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-VolumesActionsTest-720601223 Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 2fe55a7032cb47ad98b86885aad23d6c Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesActionsTest-720601223 Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-VolumesActionsTest-720601223-project Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 48b714ce386c44c88914f5a74884a52a Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-VolumesActionsTest-720601223-project Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. Sep 04 01:14:18.073062 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'a876c4e7-566f-4e4c-8f02-81a61f8cfcce'} Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:14:18.073795 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. Sep 04 01:14:18.075225 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:14:18.076897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] Returning 404 to user: Instance a876c4e7-566f-4e4c-8f02-81a61f8cfcce could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:14:18.076897 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4d053d2-f64e-4256-b0cc-3c4b3ee84167 tempest-VolumesActionsTest-720601223 tempest-VolumesActionsTest-720601223-project] 10.222.0.27 "GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce" status: 404 len: 111 microversion: 2.1 time: 0.031885 Sep 04 01:14:18.076897 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 393/775] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:18 2022] GET /compute/v2.1/servers/a876c4e7-566f-4e4c-8f02-81a61f8cfcce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:14:18.282196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:18.282800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:18.289207 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:18.290217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:18.290879 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:18.291641 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:18.292094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:18.292549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:18.425664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:18.434471 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:18.435911 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:18.437106 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-da4c0874-3d0c-49d3-b144-8a8a7a82f2f3 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.158750 Sep 04 01:14:18.437663 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 383/776] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:18 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:19.462073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:19.462684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:19.469678 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:19.470161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:19.470600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:19.471293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:19.471750 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:19.472178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:19.599958 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:19.608641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:19.610097 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:19.611246 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3957aa72-7b63-41bf-a565-ffebeeabd5db tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.153093 Sep 04 01:14:19.611802 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 394/777] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:19 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:20.637268 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:20.638603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:20.645797 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:20.646580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:20.647239 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:20.648084 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:20.648647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:20.649271 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:20.797910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:20.808300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:20.809940 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:20.811343 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-efb1d54b-d8f7-49d8-adbe-600e922a2b73 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.178614 Sep 04 01:14:20.812092 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 384/778] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:20 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:21.841340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:21.842548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:21.849496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:21.850234 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:21.850663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:21.851348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:21.851800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:21.852218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:21.994317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:22.003483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:22.004937 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:22.006297 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f263af8-ffab-4396-b1e1-d62c7464b472 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.169430 Sep 04 01:14:22.020953 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 395/779] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:21 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:23.033651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:23.035110 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:23.042221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:23.042721 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:23.043383 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:23.044324 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:23.045159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:23.045774 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:23.199363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:23.207469 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:23.208993 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:23.210146 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1f5b557e-c6b6-49af-aea4-145e5bdb70ea tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.180734 Sep 04 01:14:23.210702 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 385/780] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:23 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:24.236144 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:24.236846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:24.243227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:24.243727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:24.244161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:24.245471 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:24.245923 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:24.246344 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:24.405307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:24.413795 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:24.415642 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:24.417435 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d52bd6f-4969-4a83-a960-e6eabbdab4b4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.185668 Sep 04 01:14:24.418303 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 396/781] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:24 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:24.866715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "name": "network-vif-plugged", "status": "completed", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:24.887051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:24.887534 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:24.899197 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:24.900967 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] Creating event network-vif-plugged:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:14:24.905946 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-78074826-9f3c-4912-afcc-5961874cffe3 req-92736c5e-79ea-4992-8d66-96a5b3026f77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043270 Sep 04 01:14:24.907160 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 386/782] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:25.442783 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:25.443390 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:25.451960 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:25.452445 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:25.452907 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:25.453720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:25.454177 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:25.454602 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:25.596095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:25.605185 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:25.609282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:25.610491 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1229148b-d500-41f1-8f65-942f3caa3a31 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.171625 Sep 04 01:14:25.624643 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 397/783] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:25 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:26.637630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:26.638641 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:26.646525 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:26.647436 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:26.648270 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:26.649219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:26.649897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:26.650596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:26.809153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:26.819871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:26.821589 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:26.823946 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-de4c07e9-4560-49b2-8376-6846bfaddf04 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.192075 Sep 04 01:14:26.834154 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 387/784] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:26 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:27.854965 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:27.855819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:27.864814 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:27.865415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:27.866010 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:27.867026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:27.867662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:27.868484 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:28.013689 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:28.022041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:28.023492 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:28.024677 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de872995-31ec-433d-8efc-40ecd7c52311 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1741 microversion: 2.20 time: 0.176867 Sep 04 01:14:28.025239 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 398/785] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:27 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:29.057648 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:29.058490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:29.062500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:29.066493 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:29.066999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:29.067440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:29.068148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:29.068798 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:29.071488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:29.244831 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:29.252980 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:29.254443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:29.255601 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3701a9bb-536a-4c4b-8d85-f9eb318b896e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.201993 Sep 04 01:14:29.256150 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 388/786] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:29 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:30.282601 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:30.283190 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:30.292315 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:30.293240 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:30.294026 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:30.295017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:30.295697 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:30.296330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:30.490211 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:30.500730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:30.502828 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:30.504167 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f213e946-204a-4dc7-8831-ebde850c9a53 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.225893 Sep 04 01:14:30.504913 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 399/787] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:30 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:31.537602 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:31.538230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:31.545596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:31.546081 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:31.546515 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:31.547206 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:31.547660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:31.548084 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:31.571535 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:31.739837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:31.753822 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:31.756201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:31.757926 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-acf39af4-d33e-41b6-83d6-8f0b2619bb4f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.224070 Sep 04 01:14:31.759101 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 389/788] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:31 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:32.787197 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:32.787939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:32.790584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:32.803837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:32.803837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:32.803837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:32.803837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:32.804375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:32.804375 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:33.032877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:33.042934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:33.047028 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:33.048737 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a122920b-23b8-4344-96d9-bf982e6ae2d4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.265445 Sep 04 01:14:33.065361 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 400/789] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:32 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:34.083273 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:34.084370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:34.093050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:34.093883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:34.094443 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:34.095253 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:34.095936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:34.096653 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:34.424758 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:34.440039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:34.441860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:34.443598 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8884cebe-3a14-402e-9f93-bc9db67165ca tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.367659 Sep 04 01:14:34.444723 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 390/790] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:34 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:35.472062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:35.473424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:35.483178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:35.483938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:35.484617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:35.485667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:35.486303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:35.486926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:36.037683 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:36.046384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:36.047890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:36.049338 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-950e6641-1a7b-44f1-96ea-752884d69f01 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.581018 Sep 04 01:14:36.050069 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 401/791] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:35 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:37.079901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:37.091624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:37.091624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:37.091624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:37.091624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:37.092023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:37.092023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:37.092023 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:37.224047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:37.232305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:37.233791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:37.234975 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-77600ba7-9f98-470e-aa88-588855f956c7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.159083 Sep 04 01:14:37.235537 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 391/792] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:37 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:38.262261 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:38.263596 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:38.272918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:38.273598 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:38.274927 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:38.277553 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:38.279174 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:38.280303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:38.443440 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:38.452911 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:38.454703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:38.455960 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a72133a-062c-4e12-8ecd-89856cdbd3c1 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.199314 Sep 04 01:14:38.476641 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 402/793] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:38 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:39.489574 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:39.490183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:39.503926 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:39.505163 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:39.505927 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:39.507521 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:39.508317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:39.509320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:39.662069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:39.671603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:39.673549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:39.674958 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-92d46676-82a3-4c8f-989f-d115537d610f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.190123 Sep 04 01:14:39.675691 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 392/794] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:39 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:40.706477 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:40.707792 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:40.718878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:40.726442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:40.729031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:40.734791 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:40.736049 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:40.737571 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:40.918926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:40.929114 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:40.930945 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:40.932555 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb900de0-70b4-491d-8cfc-9e331aab8b6a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.232208 Sep 04 01:14:40.933689 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 403/795] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:40 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:41.959512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:41.960300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:41.966941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:41.967454 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:41.967895 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:41.968617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:41.969112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:41.969540 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:42.102462 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:42.111381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:42.112854 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:42.114017 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cd0b4d7c-fe8f-4619-903b-ada701b83cfc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1736 microversion: 2.20 time: 0.158365 Sep 04 01:14:42.114582 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 393/796] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:41 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:43.141531 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:43.142094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:43.148358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:43.149366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:43.149366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:43.150065 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:43.150644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:43.151076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:43.294200 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:43.302281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:43.303788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:43.304968 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c36ecf5-e09b-4e7e-b614-72aed90d78b8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1718 microversion: 2.20 time: 0.167486 Sep 04 01:14:43.305564 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 404/797] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:43 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:44.331545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:44.332267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:44.339582 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:44.340022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:44.340472 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:44.341163 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:44.341613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:44.342032 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:44.470881 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1914529399", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:44.487426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:44.496020 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:44.497501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:44.498696 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-38bb4384-68f9-422c-8045-e2e3a55defac tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1718 microversion: 2.20 time: 0.170939 Sep 04 01:14:44.499246 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 394/798] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:44 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:44.524548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:14:44.794371 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:14:44.794795 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:14:44.795384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:14:44.795675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:14:44.796088 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:14:44.804899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:44.805379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:44.805818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:44.806540 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:44.806992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:44.808334 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:44.825451 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Getting quotas for project db1b33cc7cd2466b9f9cf4e0a631941e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:14:44.829441 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Getting quotas for user 2c9fe988cac442bfa1549d9b183498c5 and project db1b33cc7cd2466b9f9cf4e0a631941e. Resources: {'instances', 'ram', 'cores'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:14:44.840173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:14:44.842473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:14:44.958461 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78e5c8ea-7bfa-49c9-8f70-695965bf9ee8 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491524 Sep 04 01:14:44.959115 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 405/799] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 01:14:44.970931 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-74cb3ac7-ce56-4f66-b913-40e8d2d2c02c tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:44.971543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-74cb3ac7-ce56-4f66-b913-40e8d2d2c02c tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:45.029313 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-74cb3ac7-ce56-4f66-b913-40e8d2d2c02c tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:45.036322 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-74cb3ac7-ce56-4f66-b913-40e8d2d2c02c tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1215 microversion: 2.1 time: 0.069331 Sep 04 01:14:45.036894 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 395/800] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:44 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:45.524547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:45.525115 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:45.532734 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:45.533242 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:45.535552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:45.535552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:45.535552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:45.535552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:45.665008 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:45.673968 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:45.675415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:45.676639 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e223c1dc-c843-4d86-9ff7-7581122a5870 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1721 microversion: 2.20 time: 0.156245 Sep 04 01:14:45.677194 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 406/801] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:45 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:45.703379 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73786eda-a367-4625-949a-cb10a1905bb8"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:45.705944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:45.713266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:45.716563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:45.716563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:45.716563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:45.716563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:45.716956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.060070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:46.060624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:46.067384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:46.070551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:46.070551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.070551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:46.070551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:46.070915 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.132258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:46.140724 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d3b4c95-1ad0-4e0a-8ab6-d2508ed32b96 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1219 microversion: 2.1 time: 0.085393 Sep 04 01:14:46.141413 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 407/802] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:46 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:46.618806 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-12c75fc4-f7d9-408e-86c2-876848f0374d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.920169 Sep 04 01:14:46.619425 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 396/803] 10.222.0.27 () {62 vars in 1364 bytes} [Sun Sep 4 01:14:45 2022] POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments => generated 188 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 01:14:46.753284 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:46.753800 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:46.760307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:46.761330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:46.761885 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.762566 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:46.763021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:46.763444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.846791 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:46.913622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "name": "network-vif-unplugged", "status": "completed", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:46.924994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:46.925477 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:46.925912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:46.936798 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.compute.server_external_events [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] Unable to find a host for instance a6e5adfb-a39d-477a-a549-cb72299066a4. Dropping event network-vif-unplugged {{(pid=121098) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 04 01:14:46.939966 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-1fe47c11-d05f-4fe1-8095-848093e25e4d req-8b6f32bf-d926-4d11-b800-56bbaa0613d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028078 Sep 04 01:14:46.939966 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 397/804] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 04 01:14:47.163291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:47.163935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:47.171009 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.171500 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.171941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.172664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.173128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.173565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.259128 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c15a652-7c2c-4f86-9103-ea0f675cc693 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments/73786eda-a367-4625-949a-cb10a1905bb8" status: 202 len: 0 microversion: 2.20 time: 0.509717 Sep 04 01:14:47.259980 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 408/805] 10.222.0.27 () {60 vars in 1457 bytes} [Sun Sep 4 01:14:46 2022] DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments/73786eda-a367-4625-949a-cb10a1905bb8 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:14:47.295779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:47.303889 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-441bd6f9-2b3d-40c7-9832-c553b25154d3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1275 microversion: 2.1 time: 0.144544 Sep 04 01:14:47.304787 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 398/806] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:47 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:47.329524 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:47.330121 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:47.335988 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.336770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.337442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.338269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.338801 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.340542 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.374426 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121099) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 01:14:47.616316 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-316837a1-18c8-4fb6-8028-b68a0dea6181 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/action" status: 202 len: 0 microversion: 2.20 time: 0.290548 Sep 04 01:14:47.617198 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 409/807] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Sep 4 01:14:47 2022] POST /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:14:47.627217 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:47.628141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:47.635599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.637274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.637274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.638040 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:47.638507 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:47.638935 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:47.824169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:47.837691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:47.840002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:47.841528 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-460530fb-8c84-416d-9f85-382cde19721a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1669 microversion: 2.20 time: 0.219547 Sep 04 01:14:47.842099 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 399/808] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:47 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:48.329282 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:48.330001 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:48.336915 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:48.337484 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:48.338614 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:48.339884 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:48.340352 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:48.340985 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:48.525129 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:48.535331 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2646de9-1cfa-4b27-83ca-bea7311084a7 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.209912 Sep 04 01:14:48.537453 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 410/809] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:48 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:48.867312 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:48.867982 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:48.875118 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:48.875616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:48.876058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:48.876785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:48.877249 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:48.877683 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:49.063680 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:49.076565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:49.077974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:49.079401 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-273e6626-6785-45cb-95f1-550e82bdbace tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1669 microversion: 2.20 time: 0.216106 Sep 04 01:14:49.079967 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 400/810] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:48 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1669 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:49.221425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3da72c-2bad-4393-a497-7e32bd9e78fd", "tag": "13f2c404-67fd-4edc-b1b7-79ac58d8cc3c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:49.233897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:49.234367 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:49.234797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:49.246134 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] Creating event network-changed:13f2c404-67fd-4edc-b1b7-79ac58d8cc3c for instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd on hv-cinder-maste Sep 04 01:14:49.251003 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2bcc3a6b-4852-48ea-bd6c-b080dfb3c100 req-ef84effb-8f7d-4b4e-8ed6-38e1ab7baf5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034770 Sep 04 01:14:49.251600 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 411/811] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:49.560920 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:49.561529 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:49.567624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:49.568196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:49.568665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:49.569351 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:49.569802 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:49.570425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:49.790004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:49.798281 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0f5b7315-80d8-43ca-8266-ba8a34427a31 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.241698 Sep 04 01:14:49.798858 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 401/812] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:49 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:50.106326 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:50.107823 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:50.116246 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:50.116768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:50.117296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:50.118304 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:50.118767 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:50.119192 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:50.253657 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:50.262465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:50.264160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:50.265386 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47351ef3-b839-4cd2-b0f9-f2d06a0a01dc tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.164616 Sep 04 01:14:50.266072 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 412/813] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:50 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:50.821441 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:50.822040 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:50.828482 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:50.828972 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:50.829411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:50.830094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:50.830558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:50.830992 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:50.957039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:50.965285 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-16412cb4-0fea-475f-99eb-a6da09cc9420 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.146983 Sep 04 01:14:50.965881 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 402/814] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:50 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:51.292033 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:51.292722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:51.299060 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:51.299534 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:51.299964 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:51.300665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:51.301119 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:51.301532 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:51.428665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:51.437047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:51.438514 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:51.439656 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c39b1a8a-59c0-4c66-ac07-5b5ecd01e64f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.151531 Sep 04 01:14:51.440209 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 413/815] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:51 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:51.988672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:51.989216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:51.996200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:51.996707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:51.997137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:51.997816 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:51.998272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:51.998691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:52.125684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:52.133188 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d6b1caf2-f1a7-4319-bdaf-ef4b12c2f574 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.148440 Sep 04 01:14:52.133747 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 403/816] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:51 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:52.465521 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:52.466133 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:52.472002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:52.472528 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:52.472961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:52.473636 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:52.474086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:52.474511 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:52.608666 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:52.619278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:52.619278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:52.619818 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0c9fb9e-ab1f-46d2-ac04-b7645de032e8 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.158898 Sep 04 01:14:52.620429 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 414/817] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:52 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:53.155519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:53.156137 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:53.162676 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:53.163159 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:53.163600 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:53.164287 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:53.164770 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:53.165201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:53.299617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:53.303210 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:53.307851 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cc55ef3a-ec7a-4aa7-9157-11c5dc097b3a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.156594 Sep 04 01:14:53.308396 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 404/818] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:53 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:53.646696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:53.647227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:53.654974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:53.656018 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:53.656802 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:53.657891 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:53.658625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:53.659275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:53.804852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:53.813548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:53.815346 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:53.816684 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-25b1f4d4-bfc9-4577-893f-a3483397bd15 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.174196 Sep 04 01:14:53.817460 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 415/819] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:53 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:54.331230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:54.332599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:54.341156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:54.342101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:54.342101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:54.342778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:54.343235 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:54.343664 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:54.500613 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:54.508704 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-583d3f75-fcfc-48c9-a423-c2059c7e01bf tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.181588 Sep 04 01:14:54.509667 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 405/820] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:54 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:54.843021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:54.843655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:54.846229 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:54.847171 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:54.851816 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:54.852378 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:54.852955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:54.853738 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:54.854296 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:54.855265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:55.008610 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:55.018431 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:55.020162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:55.021684 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84d6603f-ab0b-4059-87ee-40bdee267353 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.182669 Sep 04 01:14:55.023132 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 416/821] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:54 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:55.534532 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:55.535151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:55.537004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:55.543024 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:55.543478 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:55.543908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:55.544652 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:55.545107 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:55.545538 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:55.688424 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:55.699743 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b975496e-c587-4f6b-a7ee-00a4a9810bf9 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.168844 Sep 04 01:14:55.716975 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 406/822] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:55 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:56.047813 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:56.048407 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:56.055211 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:56.055695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:56.056127 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:56.056850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:56.057301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:56.057722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:56.195117 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:56.203867 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:56.205369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:56.206544 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d4b5f66-06be-48cc-885e-bc732cb93c9c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.162725 Sep 04 01:14:56.207174 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 417/823] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:56 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:14:56.728403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:56.729043 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:56.736589 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:56.737075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:56.737511 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:56.738201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:56.738841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:56.739267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:56.874593 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:56.882752 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2e98f745-caa4-4dff-a9aa-873a1e89ebe3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.158807 Sep 04 01:14:56.883327 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 407/824] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:56 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:57.131587 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3da72c-2bad-4393-a497-7e32bd9e78fd", "name": "network-vif-plugged", "status": "completed", "tag": "13f2c404-67fd-4edc-b1b7-79ac58d8cc3c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:14:57.152669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:57.153366 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:57.157273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:57.169622 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] Creating event network-vif-plugged:13f2c404-67fd-4edc-b1b7-79ac58d8cc3c for instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd on hv-cinder-maste Sep 04 01:14:57.174821 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-3411d480-b860-43b1-8f16-702d0e881519 req-d95ec9ef-f0ba-424a-8a7c-09c7bedb8e10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047961 Sep 04 01:14:57.175428 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 418/825] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:14:57.237975 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:57.238603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:57.245626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:57.248640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:57.248640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:57.248640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:57.248640 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:57.249346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:57.390521 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:57.398978 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:57.400440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:57.402445 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d3aa6b2a-cc8a-46a7-972a-1936653a0b4e tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.168245 Sep 04 01:14:57.403017 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 408/826] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:57 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:57.906003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:57.906804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:57.913416 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:57.913906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:57.914409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:57.915161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:57.915624 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:57.916075 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:58.051543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:58.060153 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19065554-4a77-49bc-acfd-2d87c2a0265f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.158467 Sep 04 01:14:58.060767 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 419/827] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:57 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:14:58.432504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:58.433512 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:58.440667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:58.441216 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:58.441654 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:58.442344 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:58.442795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:58.443287 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:58.860277 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:58.869100 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:58.870842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:58.872248 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-abf4b2c5-e661-4bba-a2d0-98edec88f847 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.443837 Sep 04 01:14:58.872866 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 409/828] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:58 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:14:59.084241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:59.085310 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:59.092552 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:59.093040 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:59.093478 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:59.094269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:59.094764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:59.095208 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:59.236775 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:14:59.245065 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cd956db-bd0e-4d06-b422-cab2574b5b4f tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.165127 Sep 04 01:14:59.247297 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 420/829] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:14:59 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:14:59.899398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:14:59.901031 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:14:59.903768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=46 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:14:59.908708 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:59.911096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:59.911096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:14:59.911096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:14:59.911096 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:14:59.911446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:00.061477 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:00.068418 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:00.069890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:00.071101 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0d5c125a-e8eb-45b8-86f5-b4f34705e950 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.175748 Sep 04 01:15:00.072031 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 410/830] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:14:59 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:00.269595 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:00.270250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:00.277218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:00.278571 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:00.279176 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:00.280094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:00.280574 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:00.281207 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:00.418946 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:00.427313 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-350d3490-fc84-4c03-a401-e7a44a209a67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.161476 Sep 04 01:15:00.427937 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 421/831] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:00 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:01.099041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:01.100370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:01.108033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:01.108553 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:01.108989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:01.109684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:01.110136 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:01.110559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:01.248431 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:01.257539 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:01.260201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:01.261163 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-601b7768-edf5-44fd-8fad-ab0c0307810d tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.166132 Sep 04 01:15:01.264089 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 411/832] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:01 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:01.452201 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:01.452847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:01.459895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:01.460544 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:01.461029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:01.461732 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:01.462194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:01.462757 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:01.611429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:01.620038 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe857488-e56d-4deb-bbcf-d8971b6d9fa2 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.172014 Sep 04 01:15:01.637747 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 422/833] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:01 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:02.286550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:02.287155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:02.294186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:02.294663 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:02.295095 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:02.295826 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:02.296295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:02.296726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:02.420892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:02.428861 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:02.430289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:02.431427 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1eac7d58-0017-45e0-9994-66b4bac3e17f tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.148832 Sep 04 01:15:02.431976 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 412/834] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:02 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:02.645720 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:02.646320 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:02.652948 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:02.653436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:02.653875 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:02.654560 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:02.655013 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:02.655437 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:02.780705 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:02.782971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:02.788974 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-913979ea-ff28-47df-b204-db5c79c5cd65 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.147105 Sep 04 01:15:02.789551 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 423/835] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:02 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:03.456932 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:03.457547 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:03.463420 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:03.463908 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:03.464348 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:03.465393 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:03.465752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:03.466187 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:03.594830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:03.602886 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:03.604331 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:03.605515 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cd2eec89-3d0f-4af2-9640-c26d05323d35 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.152683 Sep 04 01:15:03.606163 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 413/836] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:03 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:03.812578 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:03.813191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:03.815453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:03.820383 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:03.825268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:03.825268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:03.825268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:03.825268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:03.825652 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:03.958547 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:03.966132 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b8c4d0b-cb91-4ce3-ab8f-2d045c3d24fa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.157827 Sep 04 01:15:03.967355 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 424/837] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:03 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:04.631224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:04.631967 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:04.638724 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:04.639236 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:04.639675 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:04.640365 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:04.640847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:04.641272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:04.854261 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:04.863959 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:04.865430 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:04.866591 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3688ef58-cc3e-4170-8f08-e4b9cfe6a99a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.239330 Sep 04 01:15:04.867151 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 414/838] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:04 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:04.991027 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:04.991646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:04.997949 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:04.998692 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:04.999130 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:04.999879 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.000260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.000724 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.023882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:05.024372 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:05.031415 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.031900 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.032338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.033050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.033505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.033929 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.061202 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:15:05.145270 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:05.153552 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b98a6fe-8c6e-4355-b79f-4355852a4e67 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.167599 Sep 04 01:15:05.154728 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 425/839] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:04 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:05.174714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:05.184070 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.184563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.185035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.196252 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] Creating event network-changed:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:15:05.201231 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e4af01e0-a03f-4e44-b64e-be428a0bdaed req-1025b1f9-f6e7-48d8-a499-43ef8d3eb511 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 Sep 04 01:15:05.210946 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 426/840] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:05.357127 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-83061a85-2c78-441d-b607-4075c912487c tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 204 len: 0 microversion: 2.1 time: 0.336702 Sep 04 01:15:05.360148 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 415/841] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:05 2022] DELETE /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:15:05.366490 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:05.367124 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:05.373209 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.373688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.374120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.374794 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.375243 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.375665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.509493 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:05.518180 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8aba7e54-0ebe-4f7b-8335-f56b9870aaf9 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.155807 Sep 04 01:15:05.518759 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 427/842] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:05 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:05.892841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:05.893552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:05.899883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.900369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.900842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:05.901559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:05.902018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:05.902442 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:06.037956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:06.046566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:06.048008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:06.049209 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b7f14977-31d2-40c7-b816-0cb17494b36a tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.161355 Sep 04 01:15:06.049822 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 416/843] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:05 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:06.177729 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:06.178370 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:06.184829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:06.186035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:06.186498 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:06.187188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:06.187664 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:06.188076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:06.319362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:06.327470 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0d8fb01-2936-4b64-9c58-660c3f37c24a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.153697 Sep 04 01:15:06.328027 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 428/844] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:06 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:06.540753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:06.541382 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:06.547842 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:06.548320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:06.548788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:06.549467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:06.549917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:06.550339 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:06.677789 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:06.685777 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8f5a5b1b-5d38-4ce3-aff9-d4eb4c915c7a tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.148741 Sep 04 01:15:06.686344 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 417/845] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:06 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:07.079509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:07.100860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:07.100860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.100860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.100860 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.101275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.101275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.101275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.227604 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:07.237605 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:07.239878 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:07.241474 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3f14d7d-7c17-460f-bdc4-46f01add8480 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.170654 Sep 04 01:15:07.242197 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 429/846] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:07 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:15:07.350585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:07.351122 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:07.358136 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.358618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.359050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.359740 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.360227 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.360693 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.591973 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:07.599862 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2bc5b90e-79ff-4534-8078-2977a404d996 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.253316 Sep 04 01:15:07.600532 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 418/847] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:07 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:07.708777 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:07.709386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:07.715332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.715806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.716235 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.717017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:07.717535 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:07.718141 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:07.856332 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:07.865701 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69df0e32-451f-49f5-9066-89d09c3f731b tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.160126 Sep 04 01:15:07.865701 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 430/848] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:07 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:08.267945 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:08.268595 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:08.274401 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.274885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.275315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:08.275989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.276439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.276882 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:08.404307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:08.408376 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:08.413266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:08.414694 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:08.415837 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8df12408-05c5-4122-8442-3abeedac4f55 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.152455 Sep 04 01:15:08.416396 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 419/849] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:08 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:08.622931 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:08.624103 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:08.630577 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.631067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.631506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:08.632191 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.632694 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.633125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:08.758625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:08.767420 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f94a96df-a098-4206-b19b-fae9b9c80ece tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.148335 Sep 04 01:15:08.767990 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 431/850] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:08 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:08.889634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:08.890636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:08.897616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.898171 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.898619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:08.899329 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:08.899791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:08.900226 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:09.052752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:09.060651 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c94adf1d-868c-458b-ad8e-43f935b97c69 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1570 microversion: 2.1 time: 0.176040 Sep 04 01:15:09.061931 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 420/851] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:08 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:09.441341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:09.441955 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:09.444009 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:15:09.444137 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sun Sep 4 01:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 (ip 10.222.0.27) !!! Sep 04 01:15:09.450639 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:09.451124 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:09.451568 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:09.452248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:09.452733 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:09.453173 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:09.589859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:09.598503 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:09.599935 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:09.601115 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73bd9527-20cf-44bc-83c9-be5a7eadc2e9 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.163715 Sep 04 01:15:09.601668 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 432/852] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:09 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:09.789415 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:09.790014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:09.796591 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:09.797075 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:09.797508 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:09.798206 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:09.798669 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:09.799092 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:09.929872 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:09.937793 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d7139e66-a4c9-4f93-8d1f-557d517f8afa tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1315 microversion: 2.1 time: 0.152231 Sep 04 01:15:09.938348 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 421/853] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:09 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:10.084690 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:10.085301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:10.091559 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.092807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.093250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.093928 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.094381 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.094802 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.221537 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:10.229572 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8472076a-d3b2-49c1-952f-d06a3f8c07dd tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1451 microversion: 2.1 time: 0.148684 Sep 04 01:15:10.230161 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 433/854] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:10 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:10.628275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:10.628938 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:10.635880 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.636308 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.636779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.637505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.637963 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.638417 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.822470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf004ea-20d2-4dc5-aadf-adc76d645af3", "name": "network-vif-deleted", "tag": "1390c8ba-36ac-478c-b0ee-d190953f0aea"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:10.833336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.833822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.834234 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.846276 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] Creating event network-vif-deleted:1390c8ba-36ac-478c-b0ee-d190953f0aea for instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 on hv-cinder-maste Sep 04 01:15:10.849247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:10.851287 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-69fd1ee9-6aa1-4d7f-acef-4162ac1922a7 req-28ab06f5-5fef-450e-9cc7-57152bf5d5e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032489 Sep 04 01:15:10.851984 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 434/855] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:15:10.857785 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:10.859232 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:10.860397 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-722a7d2a-6424-473c-98bd-7b88516dcf92 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.236200 Sep 04 01:15:10.870397 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 422/856] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:10 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:10.961560 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:10.962181 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:10.968862 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.969348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.969786 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:10.970471 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:10.970922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:10.971353 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.111849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:11.121243 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b40bd71d-4f32-441b-a1ee-d288ca011a0b tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1465 microversion: 2.1 time: 0.163860 Sep 04 01:15:11.121929 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 435/857] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:10 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:11.184701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:11.186241 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:11.193719 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.194409 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.195021 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.196138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.196779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.197357 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.198136 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "name": "network-vif-plugged", "status": "completed", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:11.210263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.212132 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.212132 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.224324 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] Creating event network-vif-plugged:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:15:11.236840 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-778178cc-d2a9-4e9e-9fd7-14fe4f32ac30 req-c77b2236-fb25-4e69-a3b2-f124db47e9e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042410 Sep 04 01:15:11.241677 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 436/858] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:11.242201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:15:11.254804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:11.255504 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:11.262497 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.264373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.264899 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.265670 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.266216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.266710 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.345023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:11.359215 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0579f91d-8c87-4075-947b-cdfe76df2cff tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1220 microversion: 2.1 time: 0.109111 Sep 04 01:15:11.360170 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 437/859] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:11 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:15:11.556910 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-55c7648a-7505-4fcc-a9b8-32daf30ad162 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 204 len: 0 microversion: 2.1 time: 0.375972 Sep 04 01:15:11.557485 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 423/860] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:11 2022] DELETE /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:15:11.567287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:11.567287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:11.574163 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.574654 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.575086 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.575776 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.576746 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.577194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.705967 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:11.713859 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcf5b9af-b74c-4678-bce8-a9d5896ecdcc tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1471 microversion: 2.1 time: 0.151921 Sep 04 01:15:11.714432 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 438/861] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:11 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:11.887665 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:11.888320 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:11.895504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.895997 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.896426 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:11.897148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:11.897647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:11.903035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:12.030169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:12.038245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:12.039739 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:12.040928 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5ebceecb-f147-4442-ac1b-d90987ed9025 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.157975 Sep 04 01:15:12.041495 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 424/862] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:11 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:12.383059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:12.383674 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:12.390487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:12.390974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:12.391417 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:12.392101 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:12.392605 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:12.393039 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:12.457069 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:12.464885 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca3c5f8f-4a93-4d90-8606-a399bd16fd74 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1220 microversion: 2.1 time: 0.086180 Sep 04 01:15:12.467467 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 439/863] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:12 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:12.738417 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:12.739039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:12.745319 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:12.745811 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:12.746252 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:12.746984 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:12.747447 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:12.747876 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:12.908617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:12.916746 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-70c0fa87-6858-4961-b756-2898dd8cfc0d tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1471 microversion: 2.1 time: 0.182199 Sep 04 01:15:12.917321 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 425/864] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:12 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:13.067343 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:13.067981 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:13.073916 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.074395 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.074826 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.075495 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.075943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.076389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.202818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:13.210874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:13.212328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:13.213507 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c20b9e27-b0ba-4af9-b0fe-d000223b20f7 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.150260 Sep 04 01:15:13.214069 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 440/865] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:13 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:13.489068 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:13.489690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:13.495597 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.496074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.496531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.497207 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.497658 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.498112 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.528255 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.528759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.529191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.530356 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lazy-loading 'fault' on Instance uuid cbf004ea-20d2-4dc5-aadf-adc76d645af3 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:15:13.568977 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:13.577002 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ef7cb04b-b19b-49ad-81db-08c376a3bfbe tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1225 microversion: 2.1 time: 0.091489 Sep 04 01:15:13.577561 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 426/866] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:13 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:13.943022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:13.943610 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:13.949977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.950462 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.950895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:13.952223 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:13.952703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:13.953131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.236067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:14.239549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:14.240558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:14.245222 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf780d16-c0e4-43fc-80aa-1ff5ac29bac3 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1471 microversion: 2.1 time: 0.305896 Sep 04 01:15:14.245985 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 441/867] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:13 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:14.247204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.247767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.248847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.249630 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.250160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.250859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.446666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:14.454764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:14.456219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:14.457406 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dd4c26bd-fa01-46e6-adb6-786b7e7a5b45 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.221797 Sep 04 01:15:14.457973 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 427/868] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:14 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:15:14.599530 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:14.601019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:14.612034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.612034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.612034 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.613793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.614423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.615340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.658890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:14.691866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.692702 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.693400 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.694342 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lazy-loading 'fault' on Instance uuid cbf004ea-20d2-4dc5-aadf-adc76d645af3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:15:14.730407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3da72c-2bad-4393-a497-7e32bd9e78fd", "name": "network-vif-deleted", "tag": "13f2c404-67fd-4edc-b1b7-79ac58d8cc3c"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:14.742961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:14.743487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:14.744000 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:14.762230 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] Creating event network-vif-deleted:13f2c404-67fd-4edc-b1b7-79ac58d8cc3c for instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd on hv-cinder-maste Sep 04 01:15:14.764877 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fee1d5bc3da421fa1c85ea59223fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be21c8fcaef64d9dbecf31bd633559c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:14.769410 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-773b41b9-0ce2-4ee6-a384-49b580ac6aff req-5004aa9e-cad1-43e8-83a2-ecd156a3ec9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042500 Sep 04 01:15:14.770313 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 428/869] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:15:14.773529 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f72c9d5-3020-437b-9337-4e3effd5c6d2 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 200 len: 1225 microversion: 2.1 time: 0.178167 Sep 04 01:15:14.776918 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 442/870] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:14 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:15.270467 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:15.271166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:15.277816 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.278291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.278722 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.280203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.280565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.280994 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.311632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.312132 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.312583 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.313026 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lazy-loading 'fault' on Instance uuid 1f3da72c-2bad-4393-a497-7e32bd9e78fd {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:15:15.355676 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fe988cac442bfa1549d9b183498c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1b33cc7cd2466b9f9cf4e0a631941e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:15.363706 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b576f719-ab5f-4577-9536-51923fd8db8a tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 200 len: 1305 microversion: 2.1 time: 0.097536 Sep 04 01:15:15.366192 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 429/871] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:15 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:15:15.483091 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:15.483840 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:15.491091 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.491663 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.492109 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.492852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.493310 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.493736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.625475 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:15.633803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:15.635655 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:15.636833 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22ab9109-7738-4922-8724-2d442fb50a1c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1727 microversion: 2.20 time: 0.158234 Sep 04 01:15:15.637385 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 443/872] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:15 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 01:15:15.799239 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:15.799891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] [instance: cbf004ea-20d2-4dc5-aadf-adc76d645af3] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:15.805795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.806273 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.806702 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.807402 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:15.807852 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:15.808272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:15.821289 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] HTTP exception thrown: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Request method failure captured: Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 HTTP/1.1 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_qpKblPLfRgX8h7OcetHdl0VlLC8Q91hBxGZx5tSnI6zcjPQIo6RpA-AsNkDe2-stnIAKaphiCE1mJ-_RESOR5ikgo7p6SwSXfkKhHYujsqvuoB-Vamzt4SuygbtToL9RuF0WHfnaPqO2NWT-O78ka5TjwfNmJ5d1vEgmU5tFQ1o3k Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: be21c8fcaef64d9dbecf31bd633559c4 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-TestShelveInstance-116702865 Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:15.822993 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be21c8fcaef64d9dbecf31bd633559c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be21c8fcaef64d9dbecf31bd633559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be21c8fcaef64d9dbecf31bd633559c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be21c8fcaef64d9dbecf31bd633559c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-TestShelveInstance-116702865 Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: be21c8fcaef64d9dbecf31bd633559c4 Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-TestShelveInstance-116702865 Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-TestShelveInstance-116702865-project Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 7fee1d5bc3da421fa1c85ea59223fb54 Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-TestShelveInstance-116702865-project Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. Sep 04 01:15:15.824674 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'cbf004ea-20d2-4dc5-aadf-adc76d645af3'} Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:15.825473 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. Sep 04 01:15:15.827449 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:15.828823 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Returning 404 to user: Instance cbf004ea-20d2-4dc5-aadf-adc76d645af3 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:15.828823 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1db5c5df-1506-4372-a089-5ff99febadd7 tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3" status: 404 len: 111 microversion: 2.1 time: 0.029335 Sep 04 01:15:15.828823 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 430/873] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:15 2022] GET /compute/v2.1/servers/cbf004ea-20d2-4dc5-aadf-adc76d645af3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:16.064330 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6831ac53-3c92-4e2f-8da5-6088bd318cae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] Calling method '.version_select at 0x7fba24816a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:16.215058 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6831ac53-3c92-4e2f-8da5-6088bd318cae tempest-TestShelveInstance-116702865 tempest-TestShelveInstance-116702865-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1277331123" status: 202 len: 0 microversion: 2.1 time: 0.154756 Sep 04 01:15:16.216259 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 444/874] 10.222.0.27 () {58 vars in 1254 bytes} [Sun Sep 4 01:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1277331123 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:15:16.389445 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:16.390728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] [instance: 1f3da72c-2bad-4393-a497-7e32bd9e78fd] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:16.396974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:16.397450 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:16.397885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:16.398573 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:16.399021 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:16.399439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:16.412966 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] HTTP exception thrown: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Request method failure captured: Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd HTTP/1.1 Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_wC7wj7Vz1B8-gnhmFl7hj0TXnV0MwryZoltg8w98DbiA6WBDxyTDI3oAl8_LdQOkoJ-hrhK-wGsJfxPAAN95pr8Rax_M_cX6w0McsbIrG0IqMqlpv_WT_Zd2jE_RZiFcYmbQ4FRQ5mGR8PwLC5amQFp9qvtAWA1GRRbV2XHv3SLrQ Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: db1b33cc7cd2466b9f9cf4e0a631941e Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-VolumesNegativeTest-1224507625 Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:16.414503 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db1b33cc7cd2466b9f9cf4e0a631941e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db1b33cc7cd2466b9f9cf4e0a631941e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db1b33cc7cd2466b9f9cf4e0a631941e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db1b33cc7cd2466b9f9cf4e0a631941e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-VolumesNegativeTest-1224507625 Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: db1b33cc7cd2466b9f9cf4e0a631941e Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-VolumesNegativeTest-1224507625 Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-VolumesNegativeTest-1224507625-project Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 2c9fe988cac442bfa1549d9b183498c5 Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-VolumesNegativeTest-1224507625-project Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. Sep 04 01:15:16.416018 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '1f3da72c-2bad-4393-a497-7e32bd9e78fd'} Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:16.416929 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. Sep 04 01:15:16.418297 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:16.419483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] Returning 404 to user: Instance 1f3da72c-2bad-4393-a497-7e32bd9e78fd could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:16.419483 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9f47b7c2-4736-4ab1-bdec-d71ac7864b11 tempest-VolumesNegativeTest-1224507625 tempest-VolumesNegativeTest-1224507625-project] 10.222.0.27 "GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd" status: 404 len: 111 microversion: 2.1 time: 0.031227 Sep 04 01:15:16.419483 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 431/875] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:16 2022] GET /compute/v2.1/servers/1f3da72c-2bad-4393-a497-7e32bd9e78fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:15:16.663671 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:16.664842 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:16.672153 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:16.672867 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:16.673490 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:16.674335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:16.675029 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:16.675631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:16.810740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:16.819293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:16.820740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:16.821897 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd210194-e23c-41fe-894c-6dcaf18e24fa tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1714 microversion: 2.20 time: 0.162566 Sep 04 01:15:16.822528 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 445/876] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:15:16 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:15:28.725623 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:28.726203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:28.728936 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:28.729597 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:28.734427 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:28.734916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:28.735379 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:28.736074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:28.736558 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:28.736989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:28.760910 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6b038fef-ea9f-4657-a6b5-87f040e8d60e tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/ips" status: 200 len: 149 microversion: 2.1 time: 0.039130 Sep 04 01:15:28.761484 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 432/877] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:15:28 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:30.361804 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7253054f-6818-4460-8e18-95bbbe5c475f"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:30.364149 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:30.366556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:30.367192 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=17 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:15:30.371742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:30.372227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:30.372704 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:30.373392 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:30.373992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:30.374496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:31.052339 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6be3ab25-3615-4021-b600-de4c8251fbbb tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "POST /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694913 Sep 04 01:15:31.053018 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 446/878] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:15:30 2022] POST /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:33.397042 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:33.397603 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:33.404638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:33.405203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:33.405730 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:33.406407 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:33.406861 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:33.407281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:33.490989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'services' on Instance uuid 1128769e-8203-4356-8951-9dcc9357e608 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:15:33.681776 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4119bdfe-b4c9-4c3e-9578-8ba3aebc2f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments/7253054f-6818-4460-8e18-95bbbe5c475f" status: 202 len: 0 microversion: 2.1 time: 0.288483 Sep 04 01:15:33.682372 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 433/879] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:15:33 2022] DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments/7253054f-6818-4460-8e18-95bbbe5c475f => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:15:33.692090 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:33.694444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:33.701096 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:33.701581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:33.702022 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:33.702861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:33.703321 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:33.703901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:33.733799 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7f98343-e314-449e-9567-e638a3557f91 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Sep 04 01:15:33.734347 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 447/880] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:15:33 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:34.750106 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:34.752632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:34.758769 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:34.759254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:34.759962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:34.760687 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:34.761149 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:34.761576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:34.792205 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8fbce274-2133-42f1-9d2e-10fbcc147451 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046886 Sep 04 01:15:34.792712 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 434/881] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:15:34 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:35.804675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:35.806793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:35.813077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:35.813554 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:35.813986 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:35.814691 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:35.815139 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:35.815562 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:35.845432 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e94a6980-38a7-497c-a37a-e76262c07f8b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045552 Sep 04 01:15:35.845973 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 448/882] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:15:35 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:15:35.909060 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:35.910204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:35.916712 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:35.917196 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:35.917636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:35.918327 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:35.918779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:35.919213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:35.943989 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:15:36.265306 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-782d16eb-5d9e-4ef1-b979-7b0c7028fa8d tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 204 len: 0 microversion: 2.1 time: 0.359679 Sep 04 01:15:36.265898 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 435/883] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:35 2022] DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:15:36.274760 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:36.275369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:36.281300 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:36.282250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:36.282250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:36.282871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:36.283322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:36.283745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:36.413564 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:36.421218 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0583e5f-b2fb-445c-97b6-10af60b8ef3b tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1681 microversion: 2.1 time: 0.150236 Sep 04 01:15:36.421776 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 449/884] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:36 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:37.445187 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:37.445897 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:37.452315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:37.452833 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:37.453271 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:37.453955 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:37.454411 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:37.454837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:37.586254 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:37.593826 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-33aafbc1-df2c-4d81-83f8-719b3808f3ff tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1681 microversion: 2.1 time: 0.153744 Sep 04 01:15:37.594386 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 436/885] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:37 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:38.617418 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:38.618055 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:38.624295 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:38.624806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:38.625240 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:38.625917 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:38.626368 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:38.626788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:38.757583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:38.765655 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d5d27ce0-b4e6-4139-b5d8-db698c719434 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1681 microversion: 2.1 time: 0.152191 Sep 04 01:15:38.766213 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 450/886] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:38 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:15:39.237367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1128769e-8203-4356-8951-9dcc9357e608", "name": "network-vif-deleted", "tag": "07128323-5e76-4c1e-8df0-e3517fcb84f6"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:15:39.253777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:39.257580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:39.257580 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:39.266633 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] Creating event network-vif-deleted:07128323-5e76-4c1e-8df0-e3517fcb84f6 for instance 1128769e-8203-4356-8951-9dcc9357e608 on hv-cinder-maste Sep 04 01:15:39.271594 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-9949c0fe-d63f-4a9b-9665-3d0f976f3e22 req-4f09fe6e-50ce-4568-a728-b0ea8ad78321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037874 Sep 04 01:15:39.272183 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 437/887] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:15:39.790162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:39.790769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:39.797004 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:39.797480 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:39.797914 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:39.798594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:39.799043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:39.799465 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:39.829512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:39.829987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:39.830417 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:39.830854 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lazy-loading 'fault' on Instance uuid 1128769e-8203-4356-8951-9dcc9357e608 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:15:39.871411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5e9731f6204b44841b8524762d5a77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5de4321f9c4687a0bae83183b59a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:15:39.879291 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a80f6cd4-7f18-4640-918f-dc196637964c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 200 len: 1331 microversion: 2.1 time: 0.092913 Sep 04 01:15:39.879865 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 451/888] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:39 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:15:40.904378 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:40.905039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:40.911103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:40.911583 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:40.912010 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:40.912712 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:40.913164 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:40.913587 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:40.926497 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 HTTP/1.1 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:40.928076 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:40.929658 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '1128769e-8203-4356-8951-9dcc9357e608'} Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:40.930461 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:40.932719 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:40.934510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:40.934510 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-38b78f83-5f84-451d-9189-d543cb29e867 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 404 len: 111 microversion: 2.1 time: 0.030051 Sep 04 01:15:40.934510 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 438/889] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:40 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:40.938233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08a7459d-00b3-426d-ac53-9b101eca2065 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '.version_select at 0x7fba248168b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:41.020954 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08a7459d-00b3-426d-ac53-9b101eca2065 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-799039288" status: 202 len: 0 microversion: 2.1 time: 0.086320 Sep 04 01:15:41.021595 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 452/890] 10.222.0.27 () {58 vars in 1218 bytes} [Sun Sep 4 01:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-799039288 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:15:43.033035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:43.033510 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:43.041076 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:43.041554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:43.041984 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:43.042659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:43.043108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:43.043528 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:43.057326 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 HTTP/1.1 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:43.058825 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.060512 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '1128769e-8203-4356-8951-9dcc9357e608'} Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:43.061398 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.062842 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.064330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:43.064330 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b8cbd184-de3c-4546-9777-c44168e2927f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 404 len: 111 microversion: 2.1 time: 0.031033 Sep 04 01:15:43.064330 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 439/891] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:43 2022] DELETE /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:43.069080 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:43.069730 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 1128769e-8203-4356-8951-9dcc9357e608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:43.076230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:43.076740 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:43.077178 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:43.077863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:43.078317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:43.078744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:43.091894 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 HTTP/1.1 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:15:43.093633 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.095204 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '1128769e-8203-4356-8951-9dcc9357e608'} Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:43.096016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. Sep 04 01:15:43.098339 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:43.100042 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 1128769e-8203-4356-8951-9dcc9357e608 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:43.100042 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1c3d668-da45-4a46-b391-1e1aa984ed82 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608" status: 404 len: 111 microversion: 2.1 time: 0.030344 Sep 04 01:15:43.100042 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 453/892] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:43 2022] GET /compute/v2.1/servers/1128769e-8203-4356-8951-9dcc9357e608 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:44.411067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:44.411542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:44.417913 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.418396 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.418835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.419522 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.419981 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.420408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.433803 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 HTTP/1.1 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:44.435317 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.436894 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'dc97e3ab-3fc3-4d50-991c-fc91c80b97e1'} Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:44.437704 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.439172 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.440876 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:44.440876 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4e431b9b-fc67-46f3-895d-197e8575de0f tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 404 len: 111 microversion: 2.1 time: 0.030299 Sep 04 01:15:44.440876 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 440/893] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:44 2022] DELETE /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:44.449937 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:44.450555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: dc97e3ab-3fc3-4d50-991c-fc91c80b97e1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:44.458073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.458556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.458993 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.459675 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.460129 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.460618 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.474693 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 HTTP/1.1 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:15:44.476193 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.477741 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'dc97e3ab-3fc3-4d50-991c-fc91c80b97e1'} Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:44.478627 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. Sep 04 01:15:44.480016 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.481287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:44.481287 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-786010b1-1f83-4cc0-b090-50ba1d1f471c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1" status: 404 len: 111 microversion: 2.1 time: 0.035655 Sep 04 01:15:44.481287 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 454/894] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:44 2022] GET /compute/v2.1/servers/dc97e3ab-3fc3-4d50-991c-fc91c80b97e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:44.485966 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:44.486464 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:44.492384 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.492900 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.493339 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.494027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.494487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.494915 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.508781 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 HTTP/1.1 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:44.510546 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.512099 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '011656db-b07f-4e64-a5ac-4d911508a256'} Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:44.513160 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.514637 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.516166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:44.516166 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-df12a765-d93a-4643-b0cc-2abd228d1500 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 404 len: 111 microversion: 2.1 time: 0.029732 Sep 04 01:15:44.516166 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 441/895] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:44 2022] DELETE /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:44.520802 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:44.521407 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: 011656db-b07f-4e64-a5ac-4d911508a256] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:44.527254 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.527727 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.528160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.528859 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:44.529311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:44.529734 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:44.543654 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 HTTP/1.1 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:15:44.545225 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.546767 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '011656db-b07f-4e64-a5ac-4d911508a256'} Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:44.547791 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. Sep 04 01:15:44.549267 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:44.551444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance 011656db-b07f-4e64-a5ac-4d911508a256 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:44.551444 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dae6672f-1b34-425e-a6e2-97eceaa0752c tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256" status: 404 len: 111 microversion: 2.1 time: 0.030240 Sep 04 01:15:44.551444 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 455/896] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:44 2022] GET /compute/v2.1/servers/011656db-b07f-4e64-a5ac-4d911508a256 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:15:45.805055 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:45.805585 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:45.811877 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:45.812368 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:45.812825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:45.813509 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:45.813961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:45.814386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:45.830492 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f HTTP/1.1 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:15:45.832552 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.834054 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'c3ae8c6a-0583-43a7-b43d-d920ad04325f'} Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:45.835205 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.836675 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.838114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:45.838114 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2f5e8b34-429f-4505-979d-c947c5346123 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 404 len: 111 microversion: 2.1 time: 0.034436 Sep 04 01:15:45.838114 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 442/897] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:15:45 2022] DELETE /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:15:45.843084 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:15:45.843702 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] [instance: c3ae8c6a-0583-43a7-b43d-d920ad04325f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:15:45.850195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:45.850680 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:45.851122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:45.851807 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:15:45.852266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:15:45.852722 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:15:45.866701 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] HTTP exception thrown: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Request method failure captured: Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f HTTP/1.1 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_oj9xVnl_pXt6UMkvO0VXIU2zTrxyfSIksFFk6Q2_5WptB_LFoAHs2dUH0hoiGPhK0VZpQIMqicPRBnW-x05dXsvECPsmcLWFcBhuyuStazXjPYr1uMvaiZDn2atbP6ZubNAKIiLS65ey7l6qvgMaiW447qcQtjje40gynoknymUpc Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:15:45.868222 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef5de4321f9c4687a0bae83183b59a39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef5de4321f9c4687a0bae83183b59a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: ef5de4321f9c4687a0bae83183b59a39 Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1528808182 Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 0c5e9731f6204b44841b8524762d5a77 Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1528808182-project Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.869808 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'c3ae8c6a-0583-43a7-b43d-d920ad04325f'} Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:15:45.870753 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. Sep 04 01:15:45.872203 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:15:45.873660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] Returning 404 to user: Instance c3ae8c6a-0583-43a7-b43d-d920ad04325f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:15:45.873660 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4e128b4-4498-480d-8c02-cb0696fd1d39 tempest-AttachVolumeNegativeTest-1528808182 tempest-AttachVolumeNegativeTest-1528808182-project] 10.222.0.27 "GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f" status: 404 len: 111 microversion: 2.1 time: 0.030385 Sep 04 01:15:45.873660 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 456/898] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:15:45 2022] GET /compute/v2.1/servers/c3ae8c6a-0583-43a7-b43d-d920ad04325f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:16:12.159083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:12.161241 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:12.163545 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.164181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.168780 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.169259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.169694 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.170383 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.170850 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.171273 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.201177 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-32526d4f-78ac-409e-ae05-3290dfe69908 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045757 Sep 04 01:16:12.201718 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 443/899] 10.222.0.27 () {60 vars in 1343 bytes} [Sun Sep 4 01:16:12 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:12.275994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:12.276555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:12.279068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.280001 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:12.284688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.285164 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.285600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.286818 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.287260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.287679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.314495 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:16:12.562397 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4189d538-8a34-4af7-b20d-9d26e3a39783 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 204 len: 0 microversion: 2.20 time: 0.289953 Sep 04 01:16:12.563062 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 457/900] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Sep 4 01:16:12 2022] DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 01:16:12.572439 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:12.573012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:12.579669 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.580153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.580626 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.581305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:12.581758 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:12.582177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:12.713890 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:12.721808 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:12.723259 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:12.724411 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dbda8b98-b4df-40ab-abb7-3f9e60a97cd4 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.157136 Sep 04 01:16:12.725006 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 444/901] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:12 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:16:13.750943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:13.751644 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:13.758582 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:13.761762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:13.761762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:13.761762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:13.761762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:13.762253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:13.890205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:13.899403 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:13.900905 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:13.902067 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80796e66-3429-4f39-83e3-51eaae0dcb0b tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1720 microversion: 2.20 time: 0.155580 Sep 04 01:16:13.902699 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 458/902] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:13 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:16:14.926347 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:14.926953 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:14.933550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:14.934039 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:14.934480 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:14.935169 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:14.935659 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:14.936113 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:15.020302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:15.029491 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:15.034952 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:15.034952 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5ee14371-935b-43b7-9bd9-659e88285d56 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1652 microversion: 2.20 time: 0.109753 Sep 04 01:16:15.034952 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 445/903] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:14 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1652 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:16:15.284763 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e5adfb-a39d-477a-a549-cb72299066a4", "name": "network-vif-deleted", "tag": "9d24960e-cbea-4133-84aa-fc4b7a2c20f7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:15.295035 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:15.295588 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:15.296253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:15.307837 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] Creating event network-vif-deleted:9d24960e-cbea-4133-84aa-fc4b7a2c20f7 for instance a6e5adfb-a39d-477a-a549-cb72299066a4 on hv-cinder-maste Sep 04 01:16:15.312686 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cbc3f8fa-78ce-44a7-b7d5-10363ba44cc4 req-8d769caa-1f29-4b29-9baa-a8c9256174d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Sep 04 01:16:15.313611 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 459/904] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:16:16.058488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:16.060615 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:16.065571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:16.066087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:16.066537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:16.067225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:16.067688 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:16.068141 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:16.103220 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:16.103716 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:16.104153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:16.104709 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lazy-loading 'fault' on Instance uuid a6e5adfb-a39d-477a-a549-cb72299066a4 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:16:16.164213 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:16.175743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:16.175743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd1c41fcdc724a128117a5288b8559f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e334b7aa2f1848c1999d86ac666fe65e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:16.175743 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1d92cb96-1707-4268-a9b1-3e0ecc3c2492 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 200 len: 1370 microversion: 2.20 time: 0.121117 Sep 04 01:16:16.176218 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 446/905] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:16 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 01:16:17.206274 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:17.206974 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:17.213790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:17.214271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:17.214708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:17.215386 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:17.215839 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:17.216265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:17.229828 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 HTTP/1.1 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:16:17.231639 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:17.233374 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'a6e5adfb-a39d-477a-a549-cb72299066a4'} Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:16:17.234365 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:17.235920 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:17.237432 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:16:17.237432 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5272cb7e-6b5f-46b9-b27f-ec73307a562c tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 404 len: 111 microversion: 2.20 time: 0.031475 Sep 04 01:16:17.237432 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 460/906] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:17 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:16:17.242544 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1bbfaa85-3e5d-4463-a8f5-dce2df1bc6fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '.version_select at 0x7fba24837940>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:17.306271 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1bbfaa85-3e5d-4463-a8f5-dce2df1bc6fd tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-781119800" status: 204 len: 0 microversion: 2.20 time: 0.068238 Sep 04 01:16:17.306794 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 447/907] 10.222.0.27 () {60 vars in 1259 bytes} [Sun Sep 4 01:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-781119800 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 04 01:16:19.633428 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:19.633930 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:19.640609 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:19.641147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:19.641572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:19.642247 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:19.642700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:19.643116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:19.658139 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 HTTP/1.1 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:16:19.659749 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.664227 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'a6e5adfb-a39d-477a-a549-cb72299066a4'} Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:16:19.665111 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.666508 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.668116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:16:19.668116 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26bbf86b-97a1-43ef-8459-9eebfb99a6d0 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 404 len: 111 microversion: 2.20 time: 0.032382 Sep 04 01:16:19.668116 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 461/908] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Sep 4 01:16:19 2022] DELETE /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:16:19.671305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:19.671924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: a6e5adfb-a39d-477a-a549-cb72299066a4] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:19.678536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:19.679019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:19.679457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:19.680191 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:19.680678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:19.681108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:19.694575 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 HTTP/1.1 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:16:19.696099 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.697955 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'a6e5adfb-a39d-477a-a549-cb72299066a4'} Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:16:19.698994 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. Sep 04 01:16:19.700554 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:19.702183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance a6e5adfb-a39d-477a-a549-cb72299066a4 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:16:19.702183 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-48e070d9-c941-49d2-ac1d-a12f21bcb4a5 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4" status: 404 len: 111 microversion: 2.20 time: 0.030624 Sep 04 01:16:19.702183 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 448/909] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:19 2022] GET /compute/v2.1/servers/a6e5adfb-a39d-477a-a549-cb72299066a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:16:20.920206 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:20.920762 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:20.927099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:20.927581 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:20.928021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:20.928739 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:20.929203 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:20.929633 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:20.942743 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc HTTP/1.1 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:16:20.944271 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.946091 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '1824238e-f644-41a1-981f-e90d40bbbdfc'} Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:16:20.946945 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.948367 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.949847 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:16:20.949847 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23edb274-05ad-4a09-9863-692d0aecea59 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 404 len: 111 microversion: 2.20 time: 0.029356 Sep 04 01:16:20.949847 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 462/910] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Sep 4 01:16:20 2022] DELETE /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:16:20.953947 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:20.954566 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] [instance: 1824238e-f644-41a1-981f-e90d40bbbdfc] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:20.961516 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:20.962005 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:20.962444 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:20.963173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:20.963633 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:20.964064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:20.977942 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] HTTP exception thrown: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Request method failure captured: Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc HTTP/1.1 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_og_yIA7-ukWDqYGhAY_4cuesExL2zPgPYECvgW6_cdqMefR8fIq-3e7kg2KtvFQRurfvxddnSjvpboxpCbqJ_sAjSfAybcO2h9z4ZGO6RIafkIMAq5oIrsxQH5W64gnhmSTXVjfFfaUEUKfwYvTtbJQ4ru8cq8j51_zBi4Q6a02q0 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:16:20.979440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e334b7aa2f1848c1999d86ac666fe65e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e334b7aa2f1848c1999d86ac666fe65e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: e334b7aa2f1848c1999d86ac666fe65e Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720368543 Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: bd1c41fcdc724a128117a5288b8559f5 Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720368543-project Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.981079 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '1824238e-f644-41a1-981f-e90d40bbbdfc'} Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:16:20.981871 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. Sep 04 01:16:20.983126 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:16:20.984178 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] Returning 404 to user: Instance 1824238e-f644-41a1-981f-e90d40bbbdfc could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:16:20.984178 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7bfebacb-75cf-4112-8787-f8a366eff794 tempest-AttachVolumeShelveTestJSON-1720368543 tempest-AttachVolumeShelveTestJSON-1720368543-project] 10.222.0.27 "GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc" status: 404 len: 111 microversion: 2.20 time: 0.030660 Sep 04 01:16:20.984178 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 449/911] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Sep 4 01:16:20 2022] GET /compute/v2.1/servers/1824238e-f644-41a1-981f-e90d40bbbdfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 01:16:31.673938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:31.674701 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:31.943870 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b381459f-cd83-4669-9bc6-d3d33123eb8c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: .version_select at 0x7fba247dfe50>, body: {"keypair": {"name": "tempest-keypair-1915285227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9pMk+RBL4Fp7Pu1URKdoRP1UBJFNNWkhjnIhoV6utUXwfI/JQGbBqy1Ymfr575Z+f6Ns40wcwx6c3sqSvTJe4p1cbH0MmJtflcs3OPu2w3zpiEPBbJpiRk5DaRoZHiTA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:31.959848 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-b381459f-cd83-4669-9bc6-d3d33123eb8c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for project 5cfeb662f87744b195af64361774c98a. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:16:31.965308 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-b381459f-cd83-4669-9bc6-d3d33123eb8c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for user c5819e21fbba41d3b235daf8f0d6769b and project 5cfeb662f87744b195af64361774c98a. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:16:32.057320 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b381459f-cd83-4669-9bc6-d3d33123eb8c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.388111 Sep 04 01:16:32.064360 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 463/912] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:16:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:16:34.685801 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-705013954", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05f1b3dd-5e44-4692-9751-b8384e351207"}], "security_groups": [{"name": "tempest-securitygroup--1627326517"}], "key_name": "tempest-keypair-1915285227", "user_data": "}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:34.699596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:34.700350 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=30 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:34.978430 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] validate_networks() for [('05f1b3dd-5e44-4692-9751-b8384e351207', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:16:35.397218 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:16:35.397746 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:16:35.398386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:16:35.398805 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:16:35.399224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:16:35.408556 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:35.409051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:35.409495 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:35.410224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:35.410683 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:35.411115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:35.430224 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for project 5cfeb662f87744b195af64361774c98a. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:16:35.434655 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for user c5819e21fbba41d3b235daf8f0d6769b and project 5cfeb662f87744b195af64361774c98a. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:16:35.446798 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:16:35.449173 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:16:35.572148 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4110eb97-1b85-4303-9735-cc1ecfb5d7d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.894647 Sep 04 01:16:35.573450 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 450/913] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:16:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:16:35.585358 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e2bf285-d9c4-4639-8ba4-fe058c3e59a7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:35.585972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e2bf285-d9c4-4639-8ba4-fe058c3e59a7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:35.809438 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0e2bf285-d9c4-4639-8ba4-fe058c3e59a7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:35.817768 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e2bf285-d9c4-4639-8ba4-fe058c3e59a7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1237 microversion: 2.1 time: 0.236131 Sep 04 01:16:35.830605 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 464/914] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:35 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1237 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:36.842575 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:36.844340 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:36.852154 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:36.852671 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:36.853108 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:36.853866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:36.854322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:36.854745 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:36.918973 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:36.926624 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3c667c05-4d85-48fd-b5bd-0e674736fe0e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1241 microversion: 2.1 time: 0.088352 Sep 04 01:16:36.927198 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 451/915] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:36 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:37.951892 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:37.952535 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:37.958495 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:37.958982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:37.959424 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:37.960714 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:37.961176 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:37.961613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:38.025124 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:38.033762 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d2e97d9-f848-481a-9bb7-5e6a868f1082 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1297 microversion: 2.1 time: 0.086435 Sep 04 01:16:38.034345 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 465/916] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:37 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:39.057903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:39.058520 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:39.065044 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:39.065533 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:39.065972 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:39.066667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:39.067126 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:39.067555 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:39.282614 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:39.291020 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-be8ab5fe-d4c3-4bbf-a98d-2278b9a70078 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.237438 Sep 04 01:16:39.291598 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 452/917] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:39 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:39.723695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc75295d-59e9-40c9-bdc5-b716be88308b", "tag": "12c1cd1d-edc1-4199-8fbc-ec7e47dbd618"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:39.734558 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:39.741458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:39.741458 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:39.746991 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] Creating event network-changed:12c1cd1d-edc1-4199-8fbc-ec7e47dbd618 for instance cc75295d-59e9-40c9-bdc5-b716be88308b on hv-cinder-maste Sep 04 01:16:39.751887 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8549e5b3-a66c-4ed9-80ac-5bb417dca1be req-921afe15-f56b-494e-a9a1-7d0c8ffda420 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Sep 04 01:16:39.752501 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 466/918] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:16:40.314958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:40.315670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:40.323389 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:40.327403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:40.327403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:40.327403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:40.327403 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:40.327814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:40.532029 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:40.539885 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-35c65981-2ff8-4289-b232-4978754b4604 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.228762 Sep 04 01:16:40.540448 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 453/919] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:40 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:41.564154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:41.564909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:41.571551 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:41.572031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:41.572482 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:41.573179 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:41.573647 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:41.574073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:41.708210 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:41.716497 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4626177-4da3-4f4c-bd61-ea159ad123c7 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.157095 Sep 04 01:16:41.717103 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 467/920] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:41 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:42.741571 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:42.742228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:42.748660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:42.749147 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:42.749578 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:42.750258 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:42.750791 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:42.751218 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:42.884792 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:42.892367 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4047a198-d8fd-48d3-8432-6f07282d5d79 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.156864 Sep 04 01:16:42.892970 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 454/921] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:42 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:43.916118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:43.916748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:43.922769 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:43.923250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:43.923758 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:43.924440 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:43.924918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:43.925404 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:44.063709 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:44.067354 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c5b9edd-101c-40c7-b126-840e33fa609a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.155673 Sep 04 01:16:44.068057 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 468/922] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:43 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:45.090269 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:45.090810 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:45.097251 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:45.101078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:45.101078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:45.101078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:45.101078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:45.101514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:45.226576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:45.234825 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8e187f49-f3dd-40b8-aee4-933913843d50 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.148512 Sep 04 01:16:45.238536 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 455/923] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:45 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:45.613627 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc75295d-59e9-40c9-bdc5-b716be88308b", "name": "network-vif-plugged", "status": "completed", "tag": "12c1cd1d-edc1-4199-8fbc-ec7e47dbd618"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:45.625564 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:45.626031 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:45.626455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:45.637486 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] Creating event network-vif-plugged:12c1cd1d-edc1-4199-8fbc-ec7e47dbd618 for instance cc75295d-59e9-40c9-bdc5-b716be88308b on hv-cinder-maste Sep 04 01:16:45.642822 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-125d4f37-1462-4037-9e3a-9bd9cdb2d1a7 req-9ffca074-3073-47f0-b812-29f083cb8f88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033299 Sep 04 01:16:45.644151 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 469/924] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:16:46.258284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:46.258924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:46.261025 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:46.261666 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=6 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:46.266749 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:46.267230 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:46.267660 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:46.268406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:46.268885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:46.269309 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:46.401679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:46.409273 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-935fdf11-c43a-4723-9a9c-33b141533553 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.155666 Sep 04 01:16:46.409847 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 456/925] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:46 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:47.431676 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:47.432411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:47.434385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:16:47.439887 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:47.440377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:47.440849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:47.441533 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:47.442019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:47.442447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:47.578264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:47.586711 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80ff93f3-7a83-4212-a097-0d8e9d5c32f8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1363 microversion: 2.1 time: 0.159345 Sep 04 01:16:47.591813 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 470/926] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:47 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:48.613506 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:48.614149 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:48.620713 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:48.621203 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:48.621645 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:48.622338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:48.622800 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:48.623231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:48.752726 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:16:48.760881 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-391449a4-9f70-4238-aa76-a31373639fa6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1549 microversion: 2.1 time: 0.151155 Sep 04 01:16:48.761389 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 457/927] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:16:48 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:16:48.783273 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:16:48.783782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:16:48.790775 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:48.791248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:48.791679 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:48.792355 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:48.792832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:48.793259 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:48.867927 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c988afeb-b9d5-4c78-bca7-c9008487fcbb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088425 Sep 04 01:16:48.868548 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 471/928] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:16:48 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:16:49.836782 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc75295d-59e9-40c9-bdc5-b716be88308b", "tag": "12c1cd1d-edc1-4199-8fbc-ec7e47dbd618"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:16:49.848499 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:16:49.849001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:16:49.853115 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:16:49.861743 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] Creating event network-changed:12c1cd1d-edc1-4199-8fbc-ec7e47dbd618 for instance cc75295d-59e9-40c9-bdc5-b716be88308b on hv-cinder-maste Sep 04 01:16:49.868446 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-d71e00ef-8f7f-488d-b7f6-a5a7537bffed req-7158ffc4-b538-44b8-aa83-70d81111c9db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035461 Sep 04 01:16:49.869148 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 458/929] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:17:46.351804 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:17:46.352315 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sun Sep 4 01:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Sep 04 01:17:46.353007 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:46.353764 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=32 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:46.358541 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5360b59c-a9b7-4dfc-86f7-aaa10c18441f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'create', calling method: .version_select at 0x7fba24958700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-375906873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkqdS/he+trv4KGzuMGOqzBUesjw1/skjX9QmhEmydM7CXMSKHK3JbN/H9QFlpOPZvD/wjyOMorD0QWIdiQsvQeJABxxYBEF6vTnmJoUo18XBtQ57mhEJnSMMYt4M9tsQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:17:46.375474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-5360b59c-a9b7-4dfc-86f7-aaa10c18441f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Getting quotas for project 5a4534146f2f4d5f8f2ed8a2b9d1fb3e. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:17:46.379184 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.quota [None req-5360b59c-a9b7-4dfc-86f7-aaa10c18441f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Getting quotas for user 35e7aa6333ae45d8af239fe22fc374f2 and project 5a4534146f2f4d5f8f2ed8a2b9d1fb3e. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:17:46.495452 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5360b59c-a9b7-4dfc-86f7-aaa10c18441f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.144717 Sep 04 01:17:46.496084 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 472/930] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:17:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:17:46.549111 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-264834536", "imageRef": "8b008246-19e2-4e1f-a9e0-319c460adf23", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-375906873", "networks": [{"uuid": "019e0e37-483f-4727-a430-85455566a258"}]}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:17:46.557884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:46.559695 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=46 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:46.602728 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] validate_networks() for [('019e0e37-483f-4727-a430-85455566a258', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:17:46.978920 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:17:46.979336 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:17:46.979831 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:17:46.980904 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:17:46.981342 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:17:46.990078 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:46.990549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:46.990976 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:47.000437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:47.000437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:47.000437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:47.009628 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Getting quotas for project 5a4534146f2f4d5f8f2ed8a2b9d1fb3e. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:17:47.013887 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Getting quotas for user 35e7aa6333ae45d8af239fe22fc374f2 and project 5a4534146f2f4d5f8f2ed8a2b9d1fb3e. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:17:47.025315 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:17:47.028395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b008246-19e2-4e1f-a9e0-319c460adf23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:17:47.233543 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f1ea15c1-09af-41e3-8147-33e403e96897 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689003 Sep 04 01:17:47.234333 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 459/931] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:17:47.246399 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd399147-857e-48e4-bb63-d9d430973219 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:47.247457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd399147-857e-48e4-bb63-d9d430973219 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:47.305771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd399147-857e-48e4-bb63-d9d430973219 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:47.312994 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd399147-857e-48e4-bb63-d9d430973219 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1257 microversion: 2.1 time: 0.071473 Sep 04 01:17:47.313565 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 473/932] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:47 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:48.337263 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-5ad9257d-8d2f-4b66-b91e-3aa8fcd56734 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:48.337884 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-5ad9257d-8d2f-4b66-b91e-3aa8fcd56734 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:48.392743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-5ad9257d-8d2f-4b66-b91e-3aa8fcd56734 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:48.400188 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-5ad9257d-8d2f-4b66-b91e-3aa8fcd56734 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1257 microversion: 2.1 time: 0.067425 Sep 04 01:17:48.400780 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 460/933] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:48 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:49.423160 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:49.423780 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:49.430077 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:49.430553 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:49.430987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:49.431662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:49.432116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:49.432562 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:49.494683 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:49.502809 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfe3f351-1a18-4f06-a65f-60f1f42c3cb1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1309 microversion: 2.1 time: 0.083619 Sep 04 01:17:49.503363 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 474/934] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:49 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:50.525841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:50.526369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:50.533716 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:50.534202 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:50.535180 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:50.536183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:50.536885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:50.537843 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:50.672053 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:50.683082 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-061ee87e-f75c-4019-ab67-2b36727c8732 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1315 microversion: 2.1 time: 0.160734 Sep 04 01:17:50.684222 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 461/935] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:50 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:51.710662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:51.711415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:51.718739 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:51.719221 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:51.719648 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:51.720341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:51.720822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:51.721241 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:51.857120 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:51.865112 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-785aacec-3591-4787-be73-8a6a85b4a0fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.159501 Sep 04 01:17:51.866016 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 475/936] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:51 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:52.890302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:52.890962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:52.897608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:52.898089 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:52.898523 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:52.899220 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:52.899668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:52.900091 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:53.031488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:53.039612 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1abc560b-4280-4683-b23d-11ad542ebdd1 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.153928 Sep 04 01:17:53.040190 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 462/937] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:52 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:54.063006 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:54.063629 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:54.069938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:54.070435 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:54.070876 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:54.071570 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:54.072028 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:54.072474 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:54.210464 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:54.219153 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87e55a7b-05b5-4aa6-b899-a0fde86ae406 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.160612 Sep 04 01:17:54.233966 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 476/938] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:54 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:55.242134 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:55.242753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:55.249435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:55.249927 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:55.250364 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:55.251071 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:55.251536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:55.251962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:55.386336 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:55.395477 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c22d129f-e8ea-47d6-9143-c6d15e6cc9bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.157112 Sep 04 01:17:55.396060 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 463/939] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:55 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:56.418843 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:56.419556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:56.426158 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:56.426689 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:56.427079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:56.427776 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:56.428230 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:56.428736 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:56.562350 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:56.570494 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a64cd52-8b0c-4b05-85b0-412497994ddc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.155447 Sep 04 01:17:56.571046 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 477/940] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:56 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:57.601012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:57.601012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:57.603860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:57.611622 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:57.620682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:57.620682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:57.620682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:57.620682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:57.621090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:57.784518 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:57.796714 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1ecfe470-7511-477f-8aa7-379296071526 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.197548 Sep 04 01:17:57.796714 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 464/941] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:57 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:58.817147 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:58.817707 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:17:58.819473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:17:58.824778 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:58.825258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:58.825695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:58.826380 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:17:58.826834 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:17:58.827278 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:17:58.966597 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:17:58.975297 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f41cc02b-5e90-4c97-a0f1-cd48e9b84653 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.161981 Sep 04 01:17:58.975882 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 478/942] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:58 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:17:59.998458 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:17:59.999074 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:00.000960 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=8 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:00.006085 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:00.006568 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:00.007010 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:00.007697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:00.008160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:00.008892 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:00.133386 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:00.141569 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7cd8acd9-d61b-4905-90aa-458ec4f9a0ce tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.147573 Sep 04 01:18:00.144441 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 465/943] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:17:59 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:01.164299 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:01.164945 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:01.171412 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:01.171894 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:01.172336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:01.173068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:01.173525 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:01.173956 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:01.299002 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:01.306568 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81015ae2-cab3-4464-9374-abe686ecd245 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.146170 Sep 04 01:18:01.307138 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 479/944] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:01 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:02.330166 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:02.330761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:02.337156 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:02.337634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:02.338064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:02.338751 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:02.339201 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:02.339768 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:02.615867 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:02.615867 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8adbb3b6-5848-472f-8a0d-6b63679a0ccb tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.287713 Sep 04 01:18:02.615867 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 466/945] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:02 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:03.349743 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:03.359837 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:03.360309 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:03.360771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:03.371890 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] Creating event network-changed:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:18:03.377121 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ba4514e9-b3a6-40e2-8604-5e1ae5e880c5 req-c41a343e-f80b-4f05-a873-1ea1c6aad0a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151819 Sep 04 01:18:03.377719 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 480/946] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:03.638047 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:03.638703 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:03.644793 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:03.645287 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:03.645756 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:03.646453 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:03.646911 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:03.647343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:03.808160 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:03.816147 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e63b3b22-ae1e-4452-8f4c-f8f84a9ecbe3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.182376 Sep 04 01:18:03.820381 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 467/947] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:03 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:04.840221 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:04.841003 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:04.847987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:04.848496 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:04.849048 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:04.849741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:04.850200 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:04.850631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:04.973221 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:04.973795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:04.980088 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:04.980611 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:04.981049 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:04.981743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:04.982828 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:04.983311 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:04.984969 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:04.993095 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-819276ff-03cc-4baf-9a79-3a2c0092f2fe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.157520 Sep 04 01:18:04.993736 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 481/948] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:04 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:05.008283 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d2ca8ad6-c37e-435e-89ad-16ab80ab223b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/ips" status: 200 len: 146 microversion: 2.1 time: 0.039123 Sep 04 01:18:05.009126 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 468/949] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:18:04 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:06.015526 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:06.016136 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:06.022505 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:06.022987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:06.023423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:06.024107 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:06.024591 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:06.025017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:06.163333 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:06.171237 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e20f8685-f406-48d0-8b47-ab35c9e34ea0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.159482 Sep 04 01:18:06.171818 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 482/950] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:06 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:07.194123 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:07.194741 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:07.201551 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:07.202050 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:07.202488 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:07.203179 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:07.203633 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:07.204058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:07.423662 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:07.423662 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c1f1847a-e7d3-45fe-83a7-afbc61418a55 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.152287 Sep 04 01:18:07.423662 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 469/951] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:07 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:07.453072 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec01595a-77b8-40d6-a14c-17b6935d69c9"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:07.455450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:07.461862 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:07.462348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:07.462785 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:07.463468 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:07.463922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:07.464348 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:08.176960 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6ca8580-0191-4556-8e40-39720118cd25 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728247 Sep 04 01:18:08.177502 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 483/952] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:18:07 2022] POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:08.369398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:08.370041 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:08.376690 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:08.377168 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:08.377599 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:08.378286 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:08.378743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:08.379168 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:08.516090 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:08.523936 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-cd376b8e-590e-4223-94fa-e732b9417f75 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.158344 Sep 04 01:18:08.524521 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 470/953] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:08 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:09.548999 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:09.549708 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:09.555951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:09.556861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:09.556984 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:09.557571 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:09.558030 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:09.558456 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:09.687667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:09.695335 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a656823d-229c-49b3-b915-1bf01ce27d06 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.151918 Sep 04 01:18:09.695908 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 484/954] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:09 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:10.039278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "name": "network-vif-plugged", "status": "completed", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:10.048903 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.051037 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.051037 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.062228 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] Creating event network-vif-plugged:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:18:10.067256 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-f288082d-bd3f-489d-bdc2-f0c2d86c2794 req-e344df63-c0a7-4c3f-a4f8-3ade594e26b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090370 Sep 04 01:18:10.067854 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 471/955] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:10.427238 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:10.433534 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.434017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.434449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.494690 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 04 01:18:10.628602 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6163f816-d36c-4686-af63-228b4355f918 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action" status: 202 len: 0 microversion: 2.1 time: 0.204827 Sep 04 01:18:10.629250 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 485/956] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:18:10 2022] POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:18:10.638077 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:10.639034 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:10.645133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.645619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.646058 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.646743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.647200 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.647627 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.719376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:10.720122 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:10.726334 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.726819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.727257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.727938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:10.728387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:10.728835 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:10.782776 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:10.791138 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2f39d798-20c3-4fbd-9621-788d7d2c820b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.157471 Sep 04 01:18:10.791709 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 472/957] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:10 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:10.863389 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:10.871386 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9642d3c-7510-4645-9f62-cd9ad43cdd23 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.156612 Sep 04 01:18:10.871952 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 486/958] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:10 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:18:11.815717 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:11.816278 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:11.822912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:11.829883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:11.829883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:11.829883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:11.829883 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:11.830283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:11.896646 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:11.897262 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:11.904641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:11.904641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:11.904641 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:11.905316 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:11.905771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:11.906212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:11.956851 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:11.965108 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-72eeb5d7-b7de-4222-a4ac-890ba85b1050 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.153377 Sep 04 01:18:11.965685 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 473/959] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:11 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:18:12.034199 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:12.041698 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9247b06e-033f-4dc8-ac68-17d292cd7e01 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1357 microversion: 2.1 time: 0.148942 Sep 04 01:18:12.042264 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 487/960] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:11 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:18:12.987996 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:12.988636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:12.994945 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:12.995424 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:12.995865 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:12.996563 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:12.997019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:12.997474 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.065246 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:13.065871 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:13.072409 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.072932 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.073381 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.074349 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.074518 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.074950 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.126648 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:13.135153 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-34974b43-ba7d-4861-8a72-1cb8d0d2357b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.150970 Sep 04 01:18:13.135722 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 474/961] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:12 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:13.207396 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:13.210929 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:13.215431 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76d73b69-a3d3-4e8b-b4b8-df28ccd6d2ad tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1548 microversion: 2.1 time: 0.154056 Sep 04 01:18:13.216010 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 488/962] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:13 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:18:13.237505 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:13.238172 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:13.243985 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.244481 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.244951 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.245637 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.246093 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.246520 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.376175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:13.384055 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2b84ffd5-fa8d-4f08-b228-1c0c5d06924b tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1548 microversion: 2.1 time: 0.150157 Sep 04 01:18:13.384659 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 475/963] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:13 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:13.406046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:13.411998 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:13.411998 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Searching by: {'deleted': False, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 04 01:18:13.419757 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.420236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.420698 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.421405 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.421850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.422268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.510064 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 04 01:18:13.599933 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0af86ab4-7323-4c31-88f9-fcc400e93ce2 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197728 Sep 04 01:18:13.600524 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 489/964] 10.222.0.27 () {58 vars in 1125 bytes} [Sun Sep 4 01:18:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:13.612355 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:13.612996 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:13.618735 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.619209 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.619642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.620318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:13.620794 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:13.621212 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:13.745395 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:13.753548 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-1dc54fdf-6021-42ba-84a5-85cecdaf68be tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1548 microversion: 2.1 time: 0.144873 Sep 04 01:18:13.754118 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 476/965] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:13 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:18:14.159467 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:14.160172 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:14.166558 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:14.167038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:14.167470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:14.168145 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:14.168623 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:14.169046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:14.301307 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:14.309546 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc5a6d1d-16f2-4d48-b63a-e5daff961c85 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.154028 Sep 04 01:18:14.310453 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 490/966] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:14 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:15.333056 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:15.333673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:15.340057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:15.340579 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:15.341514 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:15.342267 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:15.342668 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:15.343133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:15.479073 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:15.488209 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9bfa6d03-3262-412f-8bc6-31d0ec2d377a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.159073 Sep 04 01:18:15.488736 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 477/967] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:15 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:15.625369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "252e67a3-cc2c-4b88-90f2-846aba0807b4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:15.627774 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:15.634314 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:15.634787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:15.635216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:15.635882 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:15.636323 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:15.636768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:16.370020 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9709023-457c-433f-9b90-d8abdd9e7a90 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748682 Sep 04 01:18:16.370849 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 491/968] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:18:15 2022] POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:16.511305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:16.511861 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:16.518701 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:16.519183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:16.519617 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:16.520298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:16.520783 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:16.521228 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:16.525501 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=100 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:16.807651 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:16.815969 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-26ef2641-37ae-462c-bee9-63b3510ccdeb tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.308670 Sep 04 01:18:16.816557 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 478/969] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:16 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:17.841194 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:17.841987 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:17.844379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:17.850128 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:17.850622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:17.851064 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:17.851825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:17.852287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:17.852741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:17.992810 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:18.001633 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f11f17df-b34c-4a2d-9678-83d2be471228 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.164857 Sep 04 01:18:18.002205 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 492/970] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:17 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:18.673691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:18.674307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:18.676678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:18.681283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:18.681750 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:18.682189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:18.682871 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:18.683330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:18.683772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:18.811425 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:18.819765 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dc5b9d80-b1d4-4192-b8dc-97d10dec2847 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1594 microversion: 2.1 time: 0.150480 Sep 04 01:18:18.820329 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 479/971] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:18 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:19.025803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:19.026340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:19.033444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:19.033923 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:19.034470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:19.035151 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:19.035602 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:19.036023 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:19.167216 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:19.175846 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49b0c425-d5e5-4dec-bd37-d2771b140681 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.154023 Sep 04 01:18:19.176485 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 493/972] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:19 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:20.199155 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:20.199760 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:20.206855 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:20.210549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:20.210549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:20.210549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:20.210549 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:20.211019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:20.449245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:20.457861 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d4330b6c-9119-41e2-b7a3-4db52db32a0c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.262560 Sep 04 01:18:20.458427 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 480/973] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:20 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:21.170450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:21.180920 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:21.181400 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:21.181861 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:21.194562 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] Creating event network-changed:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:18:21.199745 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9144dbea-ec5f-410a-933f-865575a60590 req-319f5655-8bcd-4d21-a53d-fb46c9e22712 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032807 Sep 04 01:18:21.201020 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 494/974] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:21.481692 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:21.482394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:21.488758 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:21.489565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:21.489899 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:21.490608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:21.491070 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:21.491504 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:21.724051 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:21.739008 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-181fa6d4-c336-4579-9510-f3dcd1d910f9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1724 microversion: 2.1 time: 0.260937 Sep 04 01:18:21.739820 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 481/975] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:21 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:22.764529 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:22.765227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:22.771341 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:22.771825 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:22.772260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:22.772972 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:22.773429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:22.773857 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:22.905774 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:22.914011 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5851b9dc-1506-43ec-a191-19155cbe1f2d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1701 microversion: 2.1 time: 0.154296 Sep 04 01:18:22.914519 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 495/976] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:22 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:22.937372 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:22.944378 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:22.944907 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:22.945346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:23.009519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Going to try to start instance {{(pid=121098) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 04 01:18:23.198363 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8ed4e786-534e-4a4e-91a7-7feb437d40db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action" status: 202 len: 0 microversion: 2.1 time: 0.265323 Sep 04 01:18:23.198981 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 482/977] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:18:22 2022] POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:18:23.207600 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:23.208233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:23.214289 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:23.214777 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:23.215312 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:23.217301 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:23.217790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:23.218221 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:23.368288 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:23.378397 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c37563f-8084-478e-b702-e6af88fb935c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1710 microversion: 2.1 time: 0.174624 Sep 04 01:18:23.378989 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 496/978] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:23 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1710 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:23.664260 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2045546846"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:23.670104 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:23.671189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:23.671678 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:23.672117 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:23.672849 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:23.673306 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:23.673759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:23.877617 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.network.security_group_api [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Adding security group 865ddf48-1bb2-4f24-b046-cd65ff819c7b to port 24f80f40-718f-4ddc-bdbd-9904e249edbb Sep 04 01:18:24.304695 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f752f817-3938-42d4-a572-5d7724a75f09 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.644650 Sep 04 01:18:24.308494 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 483/979] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:18:23 2022] POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:18:24.313681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:24.314376 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:24.316335 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:18:24.322038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:24.322638 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:24.323333 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:24.323487 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:18:24.324250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:24.324850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:24.325453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:24.339631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:24.340121 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:24.340602 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:24.353082 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] Creating event network-changed:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:18:24.359177 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-f0f4dd20-b093-456d-86dc-5fb7b425ab71 req-b782dd41-3622-444d-8536-1eff75ef8181 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039342 Sep 04 01:18:24.359781 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 484/980] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:18:24.404943 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:24.405722 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:24.412177 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:24.412827 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:24.413338 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:24.414110 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:24.414784 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:24.415300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:24.506047 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:24.515384 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9dadbaa-084a-40e7-840e-174e50b48352 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1760 microversion: 2.1 time: 0.205706 Sep 04 01:18:24.515978 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 497/981] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:24 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:24.657774 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:24.666386 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-73207501-e69b-49ce-a02e-eccb2a3fb38f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1710 microversion: 2.1 time: 0.266910 Sep 04 01:18:24.667075 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 485/982] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:24 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1710 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:18:25.690793 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:18:25.691425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:18:25.697773 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:25.698264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:25.698693 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:25.699359 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:18:25.699849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:18:25.700541 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:18:25.830700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:18:25.838747 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d89769d-3913-4675-b6c5-91bbb69e3eaf tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1714 microversion: 2.1 time: 0.151806 Sep 04 01:18:25.839315 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 498/983] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:18:25 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:21.173275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:21.173847 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:21.176928 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:19:21.177069 dv-cinder-master-3-smb devstack@n-api.service[121098]: Sun Sep 4 01:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments/ec01595a-77b8-40d6-a14c-17b6935d69c9 (ip 10.222.0.27) !!! Sep 04 01:19:21.178995 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=13 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:21.179662 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:21.189305 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:21.189786 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:21.190222 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:21.190910 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:21.191363 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:21.191817 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:21.274318 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lazy-loading 'services' on Instance uuid cc75295d-59e9-40c9-bdc5-b716be88308b {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:19:21.502093 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-45d8a658-7c71-4c3e-914a-27ca313fae1b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments/ec01595a-77b8-40d6-a14c-17b6935d69c9" status: 202 len: 0 microversion: 2.1 time: 0.332908 Sep 04 01:19:21.502729 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 486/984] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:19:21 2022] DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments/ec01595a-77b8-40d6-a14c-17b6935d69c9 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:19:22.624212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:19:22.626327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=13 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:22.626992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:22.632257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:22.635790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:22.635790 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:22.658379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 04 01:19:22.820869 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2866e11c-8c0a-4680-b48b-a1900d6a1c23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action" status: 202 len: 0 microversion: 2.1 time: 0.200308 Sep 04 01:19:22.821426 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 499/985] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:19:22 2022] POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:19:22.835948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:22.837264 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:22.844753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:22.845248 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:22.845686 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:22.846379 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:22.846841 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:22.847266 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:22.979057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:22.986786 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-9f76a137-8f15-45e9-94a3-6d4e028742db tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.160399 Sep 04 01:19:22.987350 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 487/986] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:22 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:24.011938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:24.012688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:24.019183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:24.019665 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:24.020436 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:24.021863 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:24.022317 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:24.022739 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:24.150385 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:24.157974 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6276753f-9420-4337-a945-af90fd5e24ad tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.151371 Sep 04 01:19:24.158539 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 500/987] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:24 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:25.044346 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:19:25.046650 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:25.054244 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.054721 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.055151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.055825 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.056335 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.056788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.181770 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:25.182379 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:25.188779 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.189264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.189702 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.190382 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.190838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.191264 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.266908 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-268a2580-60c4-41c9-b346-ced35f02d491 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.226237 Sep 04 01:19:25.267959 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 488/988] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:19:25 2022] POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:19:25.277341 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:25.279060 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:25.284781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.285275 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.285715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.287054 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:25.287854 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:25.288326 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:25.322268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:25.330217 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed26dded-992e-4bbd-8ccb-30d1e58f8c37 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.153296 Sep 04 01:19:25.331008 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 501/989] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:25 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:19:25.435475 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:25.445179 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-eb0b9d5a-dc47-484c-9e73-56196ba881cc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1752 microversion: 2.1 time: 0.172001 Sep 04 01:19:25.445776 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 489/990] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:25 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:26.355506 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:26.356116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:26.362495 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:26.368068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:26.368068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:26.368068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:26.368068 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:26.368507 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:26.470010 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:26.470624 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:26.477369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:26.477860 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:26.478300 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:26.479001 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:26.479457 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:26.479885 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:26.495087 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:26.509675 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc43ff2c-5169-4789-aa5d-53dac4b17cdc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.157851 Sep 04 01:19:26.510472 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 502/991] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:26 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:26.619778 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:26.627833 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-38a5a885-c7db-4c29-82c7-debcda72b960 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.161677 Sep 04 01:19:26.628392 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 490/992] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:26 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:19:27.533719 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:27.534363 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:27.541415 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:27.541896 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:27.542325 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:27.543001 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:27.543455 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:27.543875 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:27.651794 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:27.652432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:27.658755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:27.659237 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:27.659679 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:27.660375 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:27.660856 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:27.661288 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:27.670696 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:27.678657 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-557165bf-2689-4ac7-b373-f11d6c37dab1 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.149024 Sep 04 01:19:27.679229 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 503/993] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:27 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:27.806022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:27.814255 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-16daab15-0525-43ea-8310-bf71ee8309f3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.166419 Sep 04 01:19:27.814835 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 491/994] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:27 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:28.701982 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:28.702589 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:28.709027 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:28.709503 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:28.709937 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:28.710617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:28.711067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:28.711487 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:28.837608 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:28.838272 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:28.842154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:28.844752 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:28.845239 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:28.845674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:28.846365 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:28.846818 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:28.847240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:28.850716 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfb3f753-2497-41ee-8200-ea8cfed94c05 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.152637 Sep 04 01:19:28.855893 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 504/995] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:28 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:28.986605 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:28.995416 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8f35e8cd-bd89-48f6-9ee2-6ee257f93c83 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.161511 Sep 04 01:19:28.995988 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 492/996] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:28 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:19:29.875288 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:29.875901 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:29.883154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:29.883631 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:29.884062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:29.884866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:29.885398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:29.890858 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:30.016107 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:30.018799 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:30.019476 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:30.024003 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-184910d0-700c-456f-89b1-cf991747aa19 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.153039 Sep 04 01:19:30.024679 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 505/997] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:29 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:30.026416 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:30.026962 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:30.027460 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:30.028231 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:30.028781 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:30.029270 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:30.172893 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:30.181661 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-87874a32-df21-4331-8573-36813949c6d0 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.166718 Sep 04 01:19:30.182240 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 493/998] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:30 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:31.047681 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:31.048269 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:31.054660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:31.055131 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:31.055556 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:31.056227 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:31.056700 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:31.057118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:31.183845 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:31.191500 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00bb1306-e3c6-423c-9127-d7c09586ee92 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.147659 Sep 04 01:19:31.192064 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 506/999] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:31 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:31.204282 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:31.204928 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:31.211704 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:31.212189 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:31.212733 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:31.213463 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:31.213921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:31.214352 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:31.352358 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:31.360590 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6d095279-a9c2-4680-86c6-891caff019bc tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.160117 Sep 04 01:19:31.361159 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 494/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:31 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:32.215233 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:32.215838 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:32.222481 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:32.222964 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:32.223396 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:32.224666 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:32.225328 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:32.225742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:32.354148 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:32.361708 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9f64c64-fe0a-4bc0-b13f-c6f4572fee84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.150352 Sep 04 01:19:32.372178 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 507/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:32 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:32.384408 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:32.393543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:32.393543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:32.393543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:32.393543 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:32.393958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:32.393958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:32.393958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:32.537985 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:32.546093 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2eeedbdd-0406-4f54-88f7-63d3ee8dcc34 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.166272 Sep 04 01:19:32.552051 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 495/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:32 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:33.385710 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:33.386311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:33.392787 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:33.393265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:33.393695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:33.394369 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:33.394817 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:33.395239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:33.520154 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:33.527779 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e7af934e-2165-4140-92b4-363bcf012a5a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.146149 Sep 04 01:19:33.528346 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 508/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:33 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:33.570005 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:33.570625 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:33.576621 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:33.577111 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:33.577554 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:33.578250 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:33.578707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:33.579138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:33.799289 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:33.808146 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d4aa207c-5c53-45c1-8a03-3b06544a4443 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.242682 Sep 04 01:19:33.808748 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 496/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:33 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:34.550677 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:34.551293 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:34.558400 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:34.558893 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:34.559336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:34.560025 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:34.560505 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:34.560938 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:34.687640 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:34.696004 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d4f2cb0-6460-4420-ad61-691436511f2a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.149202 Sep 04 01:19:34.696610 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 509/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:34 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:34.831129 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:34.836949 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:34.838302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:34.838786 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:34.839227 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:34.839915 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:34.840375 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:34.840848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:34.985124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:34.993273 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0cf7559f-ecb6-40e6-86cf-086cdd6ed2cf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.166072 Sep 04 01:19:34.993851 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 497/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:34 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:35.721239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:35.721832 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:35.728144 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:35.728821 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:35.729257 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:35.729943 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:35.730396 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:35.730819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:35.861357 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:35.869477 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-319ade86-5a19-4366-ab86-2e64c7d6ae96 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.152060 Sep 04 01:19:35.870043 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 510/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:35 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:36.016148 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:36.016792 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:36.023193 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:36.023672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:36.024114 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:36.024837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:36.025298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:36.025730 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:36.165418 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:36.173456 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-0adaa944-7d1d-45d3-8d04-2407ca4668bf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1757 microversion: 2.1 time: 0.161280 Sep 04 01:19:36.174019 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 498/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:36 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:36.893572 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:36.894162 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:36.901329 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:36.901815 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:36.902283 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:36.902976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:36.903428 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:36.903852 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:37.040290 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:37.048097 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6aafcabe-d046-4182-bc71-160f8de5fdd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.158392 Sep 04 01:19:37.048704 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 511/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:36 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:19:37.197007 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:37.197578 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:37.203765 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:37.204238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:37.204706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:37.205381 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:37.206022 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:37.206449 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:37.348824 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:37.357983 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4a7f2660-9560-4f6e-a6a8-4d1efef01df3 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1760 microversion: 2.1 time: 0.164951 Sep 04 01:19:37.358563 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 499/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:37 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:38.072656 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:38.073263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:38.079517 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:38.079992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:38.080425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:38.081121 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:38.081569 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:38.081990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:38.207829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:38.215590 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa4095c0-9fad-461a-aee1-2ea893a7af20 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.147355 Sep 04 01:19:38.216168 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 512/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:38 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:39.238933 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:39.239576 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:39.246619 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:39.247098 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:39.247536 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:39.248220 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:39.248702 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:39.249128 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:39.377083 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:39.380642 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:39.385465 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-6bc28daf-c969-46ac-b342-bd390ec7ecd4 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.150426 Sep 04 01:19:39.386107 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 500/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:39 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:40.410079 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:40.410667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:40.418188 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:40.418670 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:40.419109 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:40.419788 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:40.420280 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:40.420729 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:40.546331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:40.554499 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-340c0827-26c7-4962-beca-2488ed363093 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.148262 Sep 04 01:19:40.555067 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 513/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:40 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:41.577669 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:41.578281 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:41.585008 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:41.585484 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:41.586498 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:41.587185 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:41.587638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:41.588064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:41.714472 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:41.722128 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-03290e1b-8eee-4290-b26e-3002d16f3b83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.148695 Sep 04 01:19:41.722701 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 501/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:41 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:19:42.745829 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:42.746435 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:42.752797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:42.753274 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:42.753706 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:42.754377 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:42.754828 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:42.755247 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:42.774515 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:19:43.140260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:43.147900 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bee48401-09d1-4f68-9af7-6373bd91a305 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1678 microversion: 2.1 time: 0.406708 Sep 04 01:19:43.149002 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 514/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:42 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1678 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:44.172684 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:44.173293 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:44.179941 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:44.180450 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:44.181370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:44.181596 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:44.182057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:44.182490 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:44.311234 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:44.318785 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-50650678-799a-4414-9f28-241e48a2afbe tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1655 microversion: 2.1 time: 0.150019 Sep 04 01:19:44.319346 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 502/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:44 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:44.342209 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:19:44.348768 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:44.349253 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:44.349684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:44.371134 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Going to try to start instance {{(pid=121099) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 04 01:19:44.550757 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a16b35f-f27a-4ab7-bcbb-407d92d9113f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action" status: 202 len: 0 microversion: 2.1 time: 0.212125 Sep 04 01:19:44.551454 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 515/1017] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:19:44 2022] POST /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:19:44.559672 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:44.560376 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:44.566324 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:44.568370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:44.568370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:44.568370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:44.568370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:44.568801 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:44.697674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:44.705565 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ed3d69f1-d4b4-4ccc-ab26-d923a5be7826 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1664 microversion: 2.1 time: 0.149812 Sep 04 01:19:44.706148 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 503/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:44 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:45.730260 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:45.730962 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:45.737205 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:45.738992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:45.738992 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:45.739212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:45.739617 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:45.740043 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:45.867814 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:45.875490 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a1580c45-f494-4a66-941f-1c12c7ebc8e3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1664 microversion: 2.1 time: 0.150602 Sep 04 01:19:45.876068 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 516/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:45 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:19:46.899515 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:19:46.900133 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:19:46.906837 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:46.907322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:46.907771 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:46.908480 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:19:46.908939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:19:46.909369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:19:47.040013 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:19:47.047862 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-60429db4-6397-49fb-b74d-09d978f85aba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1668 microversion: 2.1 time: 0.152224 Sep 04 01:19:47.048432 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 504/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:19:46 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:40.738429 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2045546846"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:40.738951 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:40.741281 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=36 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:40.741961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:40.747311 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:40.748255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:40.748255 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:40.748928 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:40.749380 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:40.749797 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:40.877750 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Removing security group 865ddf48-1bb2-4f24-b046-cd65ff819c7b from port 24f80f40-718f-4ddc-bdbd-9904e249edbb Sep 04 01:20:41.248862 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a49483a-a444-479f-a07f-9105742644bd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.514258 Sep 04 01:20:41.249483 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 517/1021] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Sep 4 01:20:40 2022] POST /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 01:20:41.259919 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=38 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:41.261274 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=24 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:20:41.319455 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:41.331877 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:41.332392 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:41.332853 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:41.344370 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] Creating event network-changed:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:20:41.350321 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-feb5526f-c25c-4f8f-8067-c6d919909e19 req-236ab55c-641a-49c6-bef3-e5a28b353d72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096009 Sep 04 01:20:41.351312 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 505/1022] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:42.504303 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:42.504897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:42.512150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.512298 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.512742 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.513425 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.513874 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.514291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.604447 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lazy-loading 'services' on Instance uuid 7073bd6a-4935-4149-89b0-0115b6eec9b6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:20:42.656606 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:42.659069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:42.666667 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.668552 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.669006 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.669720 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.670186 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.670618 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.701229 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-15150618-459f-4448-ad9e-ded3252f57c8 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049956 Sep 04 01:20:42.701795 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 506/1023] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:20:42 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:20:42.768631 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:42.769139 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:42.775019 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.780033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.780033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.780033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.780033 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.780435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.803181 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:20:42.846816 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88515ecf-b345-406b-a222-6bc69ce79d3c tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments/252e67a3-cc2c-4b88-90f2-846aba0807b4" status: 202 len: 0 microversion: 2.1 time: 0.346915 Sep 04 01:20:42.850484 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 518/1024] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:20:42 2022] DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments/252e67a3-cc2c-4b88-90f2-846aba0807b4 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:20:42.857626 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:42.860074 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:42.866548 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.867019 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.867522 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.868275 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:42.868824 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:42.869331 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:42.901854 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-344ffa5f-3765-4b8b-98c3-ce96ad2d7fa9 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049202 Sep 04 01:20:42.902526 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 519/1025] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:20:42 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:43.144824 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-a27941a0-b109-475a-a6a9-781bb4e8af41 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 204 len: 0 microversion: 2.1 time: 0.379708 Sep 04 01:20:43.145414 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 507/1026] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:20:42 2022] DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:20:43.154008 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:43.154653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:43.160728 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:43.161218 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:43.161659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:43.162351 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:43.162806 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:43.163266 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:43.301248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:43.310394 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eede6349-11cf-4aec-86a8-cb29efaf77ff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1674 microversion: 2.1 time: 0.160460 Sep 04 01:20:43.311155 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 520/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:43 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:43.366002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:43.375565 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:43.375906 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:43.376370 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:43.388791 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] Creating event network-changed:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:20:43.393493 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-4cebaf74-bba2-4994-8bf9-5210212ad149 req-68e53c6d-fa93-4e12-8e4f-53981a27b6e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031535 Sep 04 01:20:43.394091 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 508/1028] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:43.915236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:43.917321 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:43.923771 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:43.924250 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:43.924719 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:43.925398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:43.925846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:43.926267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:43.955571 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cabea74-22b2-4f03-a25b-757b620abce7 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Sep 04 01:20:43.956121 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 521/1029] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:20:43 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:44.335753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:44.336483 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:44.342712 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:44.343195 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:44.343636 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:44.344322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:44.344814 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:44.345247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:44.477432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:44.485835 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-59c42c27-3f7c-4612-b943-31c43df9842f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1674 microversion: 2.1 time: 0.154776 Sep 04 01:20:44.486403 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 509/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:44 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:44.968422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:44.970660 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:44.977062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:44.977539 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:44.977971 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:44.978645 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:44.979095 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:44.979541 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:45.007794 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91238df8-12e7-42ec-84d9-96f5ff223869 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Sep 04 01:20:45.008341 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 522/1031] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:20:44 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:45.509365 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:45.510079 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:45.518042 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:45.518527 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:45.518964 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:45.519862 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:45.520343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:45.520795 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:45.681312 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:45.689001 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-e0e05a3c-89f9-4208-9f23-909608e5f3c0 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1674 microversion: 2.1 time: 0.184335 Sep 04 01:20:45.689567 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 510/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:45 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:46.020906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:46.023249 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:46.030007 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.034083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.034083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.034083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.034083 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.034453 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.063739 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9724157-5d6f-44ff-b82d-95b7b1586dfe tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046942 Sep 04 01:20:46.064317 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 523/1033] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:20:46 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:20:46.075840 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:46.076707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:46.083057 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.083646 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.084188 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.085004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.085470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.085901 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.163632 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] HTTP exception thrown: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 is not attached to volume 252e67a3-cc2c-4b88-90f2-846aba0807b4 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Request method failure captured: Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments/252e67a3-cc2c-4b88-90f2-846aba0807b4 HTTP/1.1 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_yplzRcOdKRKB2aK1qUk601bicyIB2ovn6fAw8dh-jlBelT7OCnjuEDLOc_Gvv82xeX-pFxoht8QjMkl6hKpRBkRCeDP1wuFXNcIdjo84IjaRVTU2k3f3R2HfbZLq63jUV6uzHA0LUyPFqBwfO55wTIdV4lwG5jNvyZCchrESVQBuw Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 5a4534146f2f4d5f8f2ed8a2b9d1fb3e Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:20:46.166343 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a4534146f2f4d5f8f2ed8a2b9d1fb3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 5a4534146f2f4d5f8f2ed8a2b9d1fb3e Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-TestMinimumBasicScenario-755650980-project Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: 35e7aa6333ae45d8af239fe22fc374f2 Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-TestMinimumBasicScenario-755650980-project Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:20:46.167979 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 is not attached to volume 252e67a3-cc2c-4b88-90f2-846aba0807b4 Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'server_id': '7073bd6a-4935-4149-89b0-0115b6eec9b6', 'id': '252e67a3-cc2c-4b88-90f2-846aba0807b4'} Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 252e67a3-cc2c-4b88-90f2-846aba0807b4. Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:20:46.168837 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 is not attached to volume 252e67a3-cc2c-4b88-90f2-846aba0807b4 Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 is not attached to volume 252e67a3-cc2c-4b88-90f2-846aba0807b4 Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:20:46.170706 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Returning 404 to user: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 is not attached to volume 252e67a3-cc2c-4b88-90f2-846aba0807b4 {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:20:46.172030 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-f4a8c4f2-5947-4c8f-8a79-d6c53286b7fd tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments/252e67a3-cc2c-4b88-90f2-846aba0807b4" status: 404 len: 154 microversion: 2.1 time: 0.097116 Sep 04 01:20:46.172030 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 511/1034] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:20:46 2022] DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6/os-volume_attachments/252e67a3-cc2c-4b88-90f2-846aba0807b4 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 01:20:46.712850 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:46.713512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:46.719849 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.730155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.730155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.730155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.730155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.730907 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.740948 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc75295d-59e9-40c9-bdc5-b716be88308b", "name": "network-vif-deleted", "tag": "12c1cd1d-edc1-4199-8fbc-ec7e47dbd618"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:46.752775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:46.753258 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:46.753759 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:46.765376 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] Creating event network-vif-deleted:12c1cd1d-edc1-4199-8fbc-ec7e47dbd618 for instance cc75295d-59e9-40c9-bdc5-b716be88308b on hv-cinder-maste Sep 04 01:20:46.770586 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-bce68380-48a1-45d5-8005-bf43f9ee72f0 req-04098043-6daa-4816-82f3-a34cfb6bc83d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Sep 04 01:20:46.771501 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 512/1035] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:46.793855 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:46.802880 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45c16685-11f1-4b97-8ddf-209a5aedbf6c tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1606 microversion: 2.1 time: 0.093695 Sep 04 01:20:46.804059 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 524/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:46 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:47.482204 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:47.482830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:47.490071 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.490775 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.491390 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.492891 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.493238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.494335 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.522858 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Going to try to terminate instance {{(pid=121098) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:20:47.827239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:47.827825 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-4917746a-f911-4be8-bc24-3000e53ad3f4 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 204 len: 0 microversion: 2.1 time: 0.349710 Sep 04 01:20:47.828258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:47.830122 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 513/1037] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:20:47 2022] DELETE /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 01:20:47.834073 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.834561 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.840590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.840590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.840590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.840590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.841011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:47.841011 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:47.843744 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.844265 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.844755 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.845452 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.846026 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.846470 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.869684 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:47.870975 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:47.871819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:47.872267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lazy-loading 'fault' on Instance uuid cc75295d-59e9-40c9-bdc5-b716be88308b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:20:47.913564 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:47.921470 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-befbfc89-5342-4543-8a4f-659851c46a65 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 200 len: 1327 microversion: 2.1 time: 0.099240 Sep 04 01:20:47.922061 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 525/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:47 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:20:47.989944 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:47.998859 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c668fdd0-4632-4019-900e-98297b11ddac tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1554 microversion: 2.1 time: 0.166288 Sep 04 01:20:48.002670 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 514/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:47 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:20:48.945669 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:48.946279 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:48.953258 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:48.953741 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:48.957362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:48.957362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:48.957362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:48.957362 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:48.969471 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b HTTP/1.1 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:20:48.971099 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:20:48.972809 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'cc75295d-59e9-40c9-bdc5-b716be88308b'} Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:20:48.973851 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:20:48.975135 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:48.976353 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:20:48.976353 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cbd2b1bc-bb42-4ba9-8ba7-dd0e098d6649 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 404 len: 111 microversion: 2.1 time: 0.030680 Sep 04 01:20:48.976353 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 526/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:48 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:20:48.981616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-93ece3cb-0444-4b6e-bda0-64bc66b562bc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '.version_select at 0x7fba24a5baf0>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:49.024291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:49.024954 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:49.031000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:49.031476 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:49.031910 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:49.032695 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:49.033152 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:49.033579 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:49.070995 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-93ece3cb-0444-4b6e-bda0-64bc66b562bc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915285227" status: 202 len: 0 microversion: 2.1 time: 0.093274 Sep 04 01:20:49.071615 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 515/1041] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Sep 4 01:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915285227 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:20:49.217489 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:49.225885 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74ddaf55-8800-41c7-9ead-a72435fe1d92 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1554 microversion: 2.1 time: 0.205433 Sep 04 01:20:49.226462 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 527/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:49 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:20:49.920151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-143afdb5-28a7-40c0-bb2c-f0a44efc14c3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: .version_select at 0x7fba24a28820>, body: {"keypair": {"name": "tempest-keypair-1516318764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnjtKSiMg6VjYVORmGcXO10IS+I3I9tDHGeW1CNCLFGym3wGv+nYht4bVqcJwk87Bk1mXS0QMWNv0yVcz2Thdyeg0DWZwAPfm0fX6ytAZSf7vErYgYIb/3TjtAS3N/jSg=="}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:49.937064 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-143afdb5-28a7-40c0-bb2c-f0a44efc14c3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for project 5cfeb662f87744b195af64361774c98a. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:20:49.941198 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-143afdb5-28a7-40c0-bb2c-f0a44efc14c3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for user c5819e21fbba41d3b235daf8f0d6769b and project 5cfeb662f87744b195af64361774c98a. Resources: {'key_pairs'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:20:50.036977 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-143afdb5-28a7-40c0-bb2c-f0a44efc14c3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121315 Sep 04 01:20:50.037625 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 516/1043] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Sep 4 01:20:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:50.248926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:50.249713 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:50.258062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:50.258625 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:50.259135 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:50.259895 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:50.260442 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:50.261827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:50.445862 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:50.454000 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9256a743-9ce0-4294-9093-bd1749f61894 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1554 microversion: 2.1 time: 0.209103 Sep 04 01:20:50.454561 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 528/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:50 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:50.602240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7073bd6a-4935-4149-89b0-0115b6eec9b6", "name": "network-vif-deleted", "tag": "24f80f40-718f-4ddc-bdbd-9904e249edbb"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:50.611848 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:50.612323 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:50.612788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:50.623938 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] Creating event network-vif-deleted:24f80f40-718f-4ddc-bdbd-9904e249edbb for instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 on hv-cinder-maste Sep 04 01:20:50.629194 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-9467cee0-21f4-4908-aadb-f6bebc606ca3 req-39a0e5f5-0436-4c17-a7fb-fe0bfa5a7126 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Sep 04 01:20:50.629767 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 517/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:20:51.477427 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:51.478287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:51.485336 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:51.490841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:51.490841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:51.490841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:51.490841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:51.491245 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:51.521195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:51.521653 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:51.522081 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:51.522520 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lazy-loading 'fault' on Instance uuid 7073bd6a-4935-4149-89b0-0115b6eec9b6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:20:51.569463 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e7aa6333ae45d8af239fe22fc374f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4534146f2f4d5f8f2ed8a2b9d1fb3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:51.579491 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7919688b-4c3f-4f8e-a872-1d25b43d8daf tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 200 len: 1347 microversion: 2.1 time: 0.105894 Sep 04 01:20:51.586156 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 529/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:51 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:52.533183 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1946789759", "imageRef": "9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05f1b3dd-5e44-4692-9751-b8384e351207"}], "security_groups": [{"name": "tempest-securitygroup--454950435"}], "key_name": "tempest-keypair-1516318764", "user_data": "}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:20:52.603426 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:52.604011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [instance: 7073bd6a-4935-4149-89b0-0115b6eec9b6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:52.610185 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:52.610667 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:52.611155 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:52.611846 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:52.612294 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:52.612744 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:52.627403 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] HTTP exception thrown: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Request method failure captured: Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 HTTP/1.1 Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_yplzRcOdKRKB2aK1qUk601bicyIB2ovn6fAw8dh-jlBelT7OCnjuEDLOc_Gvv82xeX-pFxoht8QjMkl6hKpRBkRCeDP1wuFXNcIdjo84IjaRVTU2k3f3R2HfbZLq63jUV6uzHA0LUyPFqBwfO55wTIdV4lwG5jNvyZCchrESVQBuw Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5a4534146f2f4d5f8f2ed8a2b9d1fb3e Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:20:52.629000 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a4534146f2f4d5f8f2ed8a2b9d1fb3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a4534146f2f4d5f8f2ed8a2b9d1fb3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5a4534146f2f4d5f8f2ed8a2b9d1fb3e Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestMinimumBasicScenario-755650980 Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-TestMinimumBasicScenario-755650980-project Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: 35e7aa6333ae45d8af239fe22fc374f2 Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-TestMinimumBasicScenario-755650980-project Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. Sep 04 01:20:52.632561 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '7073bd6a-4935-4149-89b0-0115b6eec9b6'} Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:20:52.633505 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. Sep 04 01:20:52.635197 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:20:52.637291 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Returning 404 to user: Instance 7073bd6a-4935-4149-89b0-0115b6eec9b6 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:20:52.637291 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4cc758d2-b816-47c4-a1b6-873b02d0d99f tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6" status: 404 len: 111 microversion: 2.1 time: 0.030993 Sep 04 01:20:52.637291 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 530/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:52 2022] GET /compute/v2.1/servers/7073bd6a-4935-4149-89b0-0115b6eec9b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:20:52.640534 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62865b44-9d7e-4c72-88bc-f8ac53e60ab8 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] Calling method '.version_select at 0x7fba24938b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:52.642753 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.network.neutron [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] validate_networks() for [('05f1b3dd-5e44-4692-9751-b8384e351207', None, None, None, None, None)] {{(pid=121098) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 01:20:52.644997 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62865b44-9d7e-4c72-88bc-f8ac53e60ab8 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [df72e629-fbda-410f-8157-855d38cc444e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 04 01:20:53.045924 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Flavor limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 01:20:53.046366 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Image limits 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 01:20:53.046835 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Flavor pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 01:20:53.047240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Image pref 0:0:0 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 01:20:53.047697 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.virt.hardware [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 01:20:53.056307 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:53.056811 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:53.057247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:53.058670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:53.059121 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:53.059542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:53.076730 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for project 5cfeb662f87744b195af64361774c98a. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 01:20:53.080561 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.quota [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Getting quotas for user c5819e21fbba41d3b235daf8f0d6769b and project 5cfeb662f87744b195af64361774c98a. Resources: {'instances', 'ram', 'cores'} {{(pid=121098) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 01:20:53.091564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Going to run 1 instances... {{(pid=121098) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 01:20:53.094101 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ee31e07-462b-4cd1-92f7-2b0c5c13d2f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 01:20:53.204218 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [5cbb2b79-a87e-4a1f-8127-14b5a0a1200b] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 04 01:20:53.653369 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [None req-62865b44-9d7e-4c72-88bc-f8ac53e60ab8 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] [df72e629-fbda-410f-8157-855d38cc444e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48514. Sep 04 01:20:53.731767 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62865b44-9d7e-4c72-88bc-f8ac53e60ab8 tempest-TestMinimumBasicScenario-755650980 tempest-TestMinimumBasicScenario-755650980-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-375906873" status: 202 len: 0 microversion: 2.1 time: 1.096092 Sep 04 01:20:53.732361 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 531/1048] 10.222.0.27 () {58 vars in 1269 bytes} [Sun Sep 4 01:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-375906873 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:20:54.211653 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [5cbb2b79-a87e-4a1f-8127-14b5a0a1200b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48552. Sep 04 01:20:54.217280 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2b5780ef-80c0-48ae-bb28-2607af5ca500 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.689273 Sep 04 01:20:54.217927 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 518/1049] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Sep 4 01:20:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 01:20:54.229353 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e96db7e1-12dc-4053-b031-9dfe5c423d23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:54.229976 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e96db7e1-12dc-4053-b031-9dfe5c423d23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:54.288491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-e96db7e1-12dc-4053-b031-9dfe5c423d23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:54.295574 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e96db7e1-12dc-4053-b031-9dfe5c423d23 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1238 microversion: 2.1 time: 0.070259 Sep 04 01:20:54.296185 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 532/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:54 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:55.320641 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3efdb82b-99e9-462a-92f7-b909ca0c3cfc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:55.321394 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3efdb82b-99e9-462a-92f7-b909ca0c3cfc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:55.397080 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3efdb82b-99e9-462a-92f7-b909ca0c3cfc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:55.404544 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3efdb82b-99e9-462a-92f7-b909ca0c3cfc tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1238 microversion: 2.1 time: 0.088728 Sep 04 01:20:55.405115 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 519/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:55 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:56.427071 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8bf0da6a-027c-49ea-a25d-4132caa49a8a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:56.427754 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8bf0da6a-027c-49ea-a25d-4132caa49a8a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:56.482866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8bf0da6a-027c-49ea-a25d-4132caa49a8a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:56.489890 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8bf0da6a-027c-49ea-a25d-4132caa49a8a tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1238 microversion: 2.1 time: 0.066570 Sep 04 01:20:56.490456 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 533/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:56 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:57.514018 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b8982bd4-4ff6-4c00-b33b-8f373ec2f484 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:57.514638 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-b8982bd4-4ff6-4c00-b33b-8f373ec2f484 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:57.572124 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-b8982bd4-4ff6-4c00-b33b-8f373ec2f484 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:57.579408 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b8982bd4-4ff6-4c00-b33b-8f373ec2f484 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1238 microversion: 2.1 time: 0.069683 Sep 04 01:20:57.580145 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 520/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:57 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:58.602717 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:58.603926 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:58.612473 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:58.612970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:58.613411 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:58.614106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:58.614566 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:58.614994 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:58.706909 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:58.714563 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e636eb7-15fe-469b-b49f-4b64a397d979 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1242 microversion: 2.1 time: 0.115752 Sep 04 01:20:58.715462 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 534/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:58 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:20:59.737175 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:20:59.737743 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:20:59.748119 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:59.748647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:59.749094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:59.749806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:20:59.750295 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:20:59.750969 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:20:59.827125 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:20:59.836444 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3e95db26-c489-4cfd-8606-a085f5fd1a83 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1234 microversion: 2.1 time: 0.103212 Sep 04 01:20:59.837060 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 521/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:20:59 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:00.864082 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:00.867634 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:00.894725 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:00.895236 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:00.896782 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:00.898606 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:00.899076 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:00.899509 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:00.992733 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:01.005671 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0165f96a-c26b-427c-89e8-197e08bbc30b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1296 microversion: 2.1 time: 0.149618 Sep 04 01:21:01.006820 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 535/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:00 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:02.033069 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:02.033711 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:02.040435 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:02.040917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:02.042265 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:02.042915 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:02.043385 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:02.043823 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:02.244674 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:02.253803 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-12804df0-d8b2-4cf1-bcdf-eb11653abf0d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.224628 Sep 04 01:21:02.254396 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 522/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:02 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:21:02.810398 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa11851-53ac-4342-8753-cf8e84ea3cc8", "tag": "ffb1542b-91cd-41f0-92d5-aa4ca09e7939"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:21:02.820759 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:02.824041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:02.824041 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:02.834072 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] Creating event network-changed:ffb1542b-91cd-41f0-92d5-aa4ca09e7939 for instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 on hv-cinder-maste Sep 04 01:21:02.842746 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6768d81f-705b-4444-86aa-eb5ad18da9ee req-d3adac87-b73f-42c4-9676-3dbd9076f58b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036286 Sep 04 01:21:02.844434 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 536/1058] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:21:03.277537 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:03.278207 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:03.280138 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:03.284886 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:03.285375 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:03.285818 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:03.286542 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:03.287002 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:03.287430 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:03.419154 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:03.426933 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3e376251-a78f-45d7-a2ec-7ec090451e30 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.153769 Sep 04 01:21:03.427587 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 523/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:03 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:04.452287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:04.453038 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:04.459337 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:04.459827 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:04.460265 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:04.460978 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:04.461439 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:04.461866 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:04.482011 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:04.596622 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:04.603381 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b5bf4e94-a98b-48bd-b757-7c0ff6e46e9b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.156239 Sep 04 01:21:04.604030 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 537/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:04 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:05.626298 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:05.626916 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:05.633556 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:05.634045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:05.634485 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:05.635247 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:05.636020 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:05.636481 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:05.766647 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:05.774068 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-fec2a0c0-b342-4875-bf92-b515812c10e9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.151653 Sep 04 01:21:05.774632 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 524/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:05 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:06.797880 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:06.798446 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:06.801134 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 01:21:06.801292 dv-cinder-master-3-smb devstack@n-api.service[121099]: Sun Sep 4 01:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 (ip 10.222.0.27) !!! Sep 04 01:21:06.803267 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:06.811422 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:06.820628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:06.820628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:06.820628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:06.820628 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:06.821113 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:06.952752 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:06.960397 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55eba2eb-06e5-4371-b970-43afcb56a0a6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.166558 Sep 04 01:21:06.960994 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 538/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:06 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:07.983164 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:07.983790 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:07.986432 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell0:SELECT=14 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:07.991214 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:07.991707 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:07.992153 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:07.992875 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:07.993344 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:07.993779 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:08.014974 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:08.126143 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:08.133814 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-3670170c-602c-4983-ae59-c7578d3dccf3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.154759 Sep 04 01:21:08.134377 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 525/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:07 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:08.760384 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa11851-53ac-4342-8753-cf8e84ea3cc8", "name": "network-vif-plugged", "status": "completed", "tag": "ffb1542b-91cd-41f0-92d5-aa4ca09e7939"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:21:08.770270 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:08.772483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:08.772483 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:08.782255 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] Creating event network-vif-plugged:ffb1542b-91cd-41f0-92d5-aa4ca09e7939 for instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 on hv-cinder-maste Sep 04 01:21:08.787268 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9aed561f-ab6c-4a93-a3ee-72dbcd277415 req-0a7649e9-607a-4271-8b60-c50fca61a806 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Sep 04 01:21:08.787893 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 539/1064] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:21:09.156830 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:09.157473 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:09.164700 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:09.165192 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:09.165632 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:09.166330 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:09.166788 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:09.168418 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:09.302335 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:09.310130 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-80ce676e-ed1c-4500-87ed-1dc00bfbf27d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.157161 Sep 04 01:21:09.310703 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 526/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:09 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:21:10.334212 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:10.334906 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:10.341062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:10.341542 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:10.341970 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:10.342643 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:10.343094 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:10.343517 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:10.478059 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:10.487042 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dbfd2ad-fb0b-4869-91c1-3a8beb4a657f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1363 microversion: 2.1 time: 0.157402 Sep 04 01:21:10.487585 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 540/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:10 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:11.509691 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:11.510299 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:11.512661 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:11.517238 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:11.517715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:11.521921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:11.521921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:11.521921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:11.521921 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:11.647103 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:21:11.655011 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2583df52-2bb5-4889-b17c-5e132c64adfa tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1550 microversion: 2.1 time: 0.149359 Sep 04 01:21:11.655582 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 527/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:21:11 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:21:11.677248 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:21:11.677745 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:21:11.680116 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:21:11.685449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:11.685934 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:11.686373 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:11.687129 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:11.687571 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:11.687997 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:11.765214 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e7564cf-cfe3-4294-9aa8-9503154bf15b tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091743 Sep 04 01:21:11.765807 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 541/1068] 10.222.0.27 () {58 vars in 1275 bytes} [Sun Sep 4 01:21:11 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 01:21:12.993368 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa11851-53ac-4342-8753-cf8e84ea3cc8", "tag": "ffb1542b-91cd-41f0-92d5-aa4ca09e7939"}]} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:21:13.003562 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:21:13.004067 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:21:13.004591 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:21:13.016160 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.compute.server_external_events [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] Creating event network-changed:ffb1542b-91cd-41f0-92d5-aa4ca09e7939 for instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 on hv-cinder-maste Sep 04 01:21:13.021209 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [req-670a5c38-4123-4bc0-9560-908de8bdb9f2 req-a2a428a2-01f1-4726-84e4-f95d285261d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031543 Sep 04 01:21:13.021897 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 528/1069] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:28.290577 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=20 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.296262 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:28.519991 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:28.523686 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:28.526340 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:28.526824 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:28.527263 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:28.527941 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:28.528394 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:28.528841 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:28.552095 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cfb380b-5370-454c-a874-08e14d29edec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/ips" status: 200 len: 147 microversion: 2.1 time: 0.263467 Sep 04 01:22:28.552679 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 542/1070] 10.222.0.27 () {58 vars in 1248 bytes} [Sun Sep 4 01:22:28 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/ips => generated 147 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:30.151777 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_api:SELECT=3 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:30.152550 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG dbcounter [-] [121098] Writing DB stats nova_cell1:SELECT=16 {{(pid=121098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 01:22:30.157094 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beca842b-3f6a-4501-a7be-58f08df9537e"}} {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:22:30.159478 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:30.165446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:30.165939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:30.166414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:30.167109 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:30.167572 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:30.168004 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:31.054484 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8bd98738-62bb-4970-9df9-eed0d44f54d6 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903601 Sep 04 01:22:31.054484 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 529/1071] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:22:30 2022] POST /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:33.294717 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:33.297626 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:33.303939 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:33.304417 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:33.304881 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:33.305563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:33.306046 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:33.306470 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:33.335356 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23282a6c-ccda-4a4b-bc9a-05e3e7127815 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Sep 04 01:22:33.335908 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 543/1072] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:22:33 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:33.348225 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:33.348958 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:33.355045 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:33.355531 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:33.355968 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:33.356682 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:33.357136 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:33.357559 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:33.386233 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d01f1d0d-c7b7-4657-9935-8f58fcea0e27 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e" status: 200 len: 194 microversion: 2.1 time: 0.043432 Sep 04 01:22:33.386796 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 530/1073] 10.222.0.27 () {58 vars in 1413 bytes} [Sun Sep 4 01:22:33 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:34.963512 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf00327f-38be-442b-8e2c-88c4dfadae01"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:22:34.965881 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:34.972990 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:34.973479 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:34.973961 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:34.974659 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:34.975115 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:34.975543 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:35.813419 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b5de5265-0ae9-4c0a-b405-f90667dc9fba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "POST /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852726 Sep 04 01:22:35.814081 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 544/1074] 10.222.0.27 () {60 vars in 1323 bytes} [Sun Sep 4 01:22:34 2022] POST /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:39.117068 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:39.119310 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:39.125807 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.126283 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.126715 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.127400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.127857 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.128280 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.157886 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-c92b16c9-32d9-4867-b2ca-38fec2cbc635 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045009 Sep 04 01:22:39.158427 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 531/1075] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:22:39 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:39.302491 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:39.303062 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:39.309397 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.309873 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.310305 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.310977 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.311423 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.311851 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.342830 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18f75434-0617-4e3a-9b66-f3970d1a1cba tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e" status: 200 len: 194 microversion: 2.1 time: 0.045994 Sep 04 01:22:39.343996 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 545/1076] 10.222.0.27 () {58 vars in 1413 bytes} [Sun Sep 4 01:22:39 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:39.354673 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:39.355170 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:39.361764 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.362245 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.362683 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.363367 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:39.363822 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:39.364248 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:39.445519 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lazy-loading 'services' on Instance uuid 5aa11851-53ac-4342-8753-cf8e84ea3cc8 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:22:39.617071 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-dfecdb13-88dd-4a35-9860-9a740d05aeff tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e" status: 202 len: 0 microversion: 2.1 time: 0.266176 Sep 04 01:22:39.617656 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 532/1077] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:22:39 2022] DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/beca842b-3f6a-4501-a7be-58f08df9537e => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:22:41.803575 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:41.804150 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:41.810546 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:41.811024 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:41.811457 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:41.812184 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:41.812676 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:41.813099 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:41.841987 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b2541e6-5b89-452e-9164-b00914c79d84 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/cf00327f-38be-442b-8e2c-88c4dfadae01" status: 200 len: 194 microversion: 2.1 time: 0.042305 Sep 04 01:22:41.842569 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 546/1078] 10.222.0.27 () {58 vars in 1413 bytes} [Sun Sep 4 01:22:41 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/cf00327f-38be-442b-8e2c-88c4dfadae01 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:41.854369 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:41.854954 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:41.861912 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:41.862398 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:41.862840 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:41.863556 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:41.864012 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:41.864446 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:41.944014 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lazy-loading 'services' on Instance uuid 5aa11851-53ac-4342-8753-cf8e84ea3cc8 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:22:42.153809 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ba23b537-203a-4c00-986e-d4221873050f tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/cf00327f-38be-442b-8e2c-88c4dfadae01" status: 202 len: 0 microversion: 2.1 time: 0.304116 Sep 04 01:22:42.154402 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 533/1079] 10.222.0.27 () {58 vars in 1416 bytes} [Sun Sep 4 01:22:41 2022] DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments/cf00327f-38be-442b-8e2c-88c4dfadae01 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:22:44.387302 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:44.389594 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:44.396044 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.396563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.397013 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.397703 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.398161 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.398590 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.428115 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e1a331c-c4ba-4948-981d-a2273c441fd2 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044757 Sep 04 01:22:44.428697 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 547/1080] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:22:44 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:22:44.543396 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:44.545736 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:44.552796 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.553284 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.553723 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.554409 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.554866 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.555296 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.585363 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-20db5342-4f4b-4e7c-8f54-1db0b8c45c53 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046660 Sep 04 01:22:44.585909 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 534/1081] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Sep 4 01:22:44 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 01:22:44.650092 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:44.650613 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:44.656452 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.656959 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.657897 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.658583 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.659037 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.659459 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.684268 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 01:22:44.977502 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4728977-0ecf-47ea-953a-a6510f00873d tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 204 len: 0 microversion: 2.1 time: 0.330978 Sep 04 01:22:44.978072 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 548/1082] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:22:44 2022] DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 01:22:44.986292 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:44.987517 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:44.993917 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.994399 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.994877 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:44.995564 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:44.996016 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:44.996437 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:45.129950 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:22:45.138150 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-ae57b2bc-1609-4bed-b7f9-675d4b4c86d9 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1675 microversion: 2.1 time: 0.155773 Sep 04 01:22:45.138706 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 535/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:44 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 01:22:46.163183 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:46.163885 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:46.170322 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:46.170803 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:46.171237 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:46.171918 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:46.172371 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:46.172821 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:46.303662 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.policy [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:22:46.309342 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c07c695-0663-42bf-af2a-fcccd23379ec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1675 microversion: 2.1 time: 0.151032 Sep 04 01:22:46.309912 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 549/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:46 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:22:47.333414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:47.334027 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:47.340242 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:47.340767 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:47.341209 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:47.341889 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:47.342340 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:47.342761 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:47.471035 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:22:47.479098 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-d3541512-d8d5-469e-95e7-d3d472e22728 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1675 microversion: 2.1 time: 0.149857 Sep 04 01:22:47.479670 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 536/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:47 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:22:48.055819 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa11851-53ac-4342-8753-cf8e84ea3cc8", "name": "network-vif-deleted", "tag": "ffb1542b-91cd-41f0-92d5-aa4ca09e7939"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 01:22:48.067195 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:48.067748 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:48.068182 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:48.079742 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] Creating event network-vif-deleted:ffb1542b-91cd-41f0-92d5-aa4ca09e7939 for instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 on hv-cinder-maste Sep 04 01:22:48.085294 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b5f5aa43-c795-4b81-b781-619a349573ae req-1f81b7c8-2bfc-48a9-8bb8-55a91c168d3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 Sep 04 01:22:48.086088 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 550/1086] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Sep 4 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 01:22:48.503400 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:48.504331 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:48.511772 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:48.512270 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:48.514219 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:48.514939 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:48.515406 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:48.515838 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:48.547634 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:48.548151 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:48.548616 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:48.549087 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.objects.instance [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lazy-loading 'fault' on Instance uuid 5aa11851-53ac-4342-8753-cf8e84ea3cc8 {{(pid=121098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 01:22:48.590448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.policy [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5819e21fbba41d3b235daf8f0d6769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfeb662f87744b195af64361774c98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121098) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 01:22:48.598532 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-2ab705b8-bfbf-4256-8000-6f63d1129fec tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 200 len: 1328 microversion: 2.1 time: 0.099682 Sep 04 01:22:48.599110 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 537/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:48 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 01:22:49.622106 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:49.622805 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:49.630908 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:49.631387 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:49.631822 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:49.632563 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:49.633021 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:49.633449 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:49.647392 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 HTTP/1.1 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:22:49.649024 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:49.650718 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '5aa11851-53ac-4342-8753-cf8e84ea3cc8'} Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:22:49.651705 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:49.653340 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:49.654834 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:22:49.654834 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85bb3da6-c36f-4e23-9d87-71bb3ef5f561 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 404 len: 111 microversion: 2.1 time: 0.032522 Sep 04 01:22:49.654834 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 551/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:49 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:22:49.659677 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-b3731b1e-07bb-44e1-9626-c38d4e608455 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '.version_select at 0x7fba24a5f040>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:49.735030 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-b3731b1e-07bb-44e1-9626-c38d4e608455 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516318764" status: 202 len: 0 microversion: 2.1 time: 0.079486 Sep 04 01:22:49.735618 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 538/1089] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Sep 4 01:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516318764 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 01:22:53.031568 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:53.032067 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:53.038638 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:53.039118 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:53.039555 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:53.040239 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:53.040802 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:53.041232 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:53.054936 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 HTTP/1.1 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:22:53.056450 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.058187 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': '5aa11851-53ac-4342-8753-cf8e84ea3cc8'} Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:22:53.059102 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.060382 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.061688 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:22:53.061688 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3407de6e-9fdd-49de-921b-b222e27a44f3 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 404 len: 111 microversion: 2.1 time: 0.030111 Sep 04 01:22:53.061688 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 552/1090] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:22:53 2022] DELETE /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:22:53.067995 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:53.068670 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: 5aa11851-53ac-4342-8753-cf8e84ea3cc8] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:53.075322 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:53.075806 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:53.076240 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:53.076956 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:53.077416 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:53.077844 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:53.091295 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 HTTP/1.1 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:22:53.092961 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.094563 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': '5aa11851-53ac-4342-8753-cf8e84ea3cc8'} Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:22:53.095422 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. Sep 04 01:22:53.097044 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:53.098414 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance 5aa11851-53ac-4342-8753-cf8e84ea3cc8 could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:22:53.098414 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-8bcbd0c1-d9ee-4273-b310-44eb96f0683e tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8" status: 404 len: 111 microversion: 2.1 time: 0.032054 Sep 04 01:22:53.098414 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 539/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:53 2022] GET /compute/v2.1/servers/5aa11851-53ac-4342-8753-cf8e84ea3cc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:22:54.345414 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:54.345922 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:54.352372 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:54.352890 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:54.353327 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:54.354125 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:54.354584 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:54.355017 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:54.368766 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b HTTP/1.1 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept: application/json Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Accept-Encoding: identity Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Connection: close Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Length: 0 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Content-Type: application/json Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Host: 10.222.0.27 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: Openstack-System-Scope: None Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Id: None Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Domain-Name: None Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Identity-Status: Confirmed Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Is-Admin-Project: True Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Id: default Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Domain-Name: Default Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Role: reader,member Sep 04 01:22:54.370287 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Roles: reader,member Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Id: default Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Domain-Name: Default Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: method: > Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: exception: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.371942 dv-cinder-master-3-smb devstack@n-api.service[121099]: action_args: {'id': 'cc75295d-59e9-40c9-bdc5-b716be88308b'} Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:22:54.372776 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.374090 dv-cinder-master-3-smb devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.375444 dv-cinder-master-3-smb devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:22:54.375444 dv-cinder-master-3-smb devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44d35902-a48b-473f-a541-a49178b7f651 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 404 len: 111 microversion: 2.1 time: 0.030131 Sep 04 01:22:54.375444 dv-cinder-master-3-smb devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 553/1092] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Sep 4 01:22:54 2022] DELETE /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 01:22:54.381302 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Calling method '>' {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 01:22:54.381979 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.compute.api [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] [instance: cc75295d-59e9-40c9-bdc5-b716be88308b] Fetching instance by UUID {{(pid=121098) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 01:22:54.388287 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:54.388859 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:54.389291 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:54.389983 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Acquiring lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 01:22:54.390448 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 01:22:54.390875 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG oslo_concurrency.lockutils [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Lock "dc3b8d54-b65b-4a03-8b15-ffedafddfc58" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 01:22:54.403898 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.wsgi [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] HTTP exception thrown: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Request method failure captured: Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: request: GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b HTTP/1.1 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept: application/json Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Accept-Encoding: identity Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Connection: close Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Length: 0 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Content-Type: application/json Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Host: 10.222.0.27 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: Openstack-System-Scope: None Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: User-Agent: python-urllib3/1.26.12 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Auth-Token: gAAAAABjE_xv_PG2x_LfvPnAok10SfeiZaJyZ-rlXMTAdO3xrFTCB1ZCbbEi68eJrjKDB4tHPo9YO13popQs5uBLslhjYYbaaUS1f1vz27cgvfxCFq5TrrzIDC6VDosH1JHp15OOGHHcRbTNSfycyaGKSmsrw6GzYsXx38JsXlJQ-qdXoaUK_X4 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Id: None Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Domain-Name: None Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Identity-Status: Confirmed Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Is-Admin-Project: True Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Id: default Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Domain-Name: Default Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Project-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Role: reader,member Sep 04 01:22:54.405440 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Roles: reader,member Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cfeb662f87744b195af64361774c98a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cfeb662f87744b195af64361774c98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cfeb662f87744b195af64361774c98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Id: 5cfeb662f87744b195af64361774c98a Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1533856579 Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Id: default Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Domain-Name: Default Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Id: c5819e21fbba41d3b235daf8f0d6769b Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: X-User-Name: tempest-AttachVolumeTestJSON-1533856579-project Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: method: > Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: exception: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.407022 dv-cinder-master-3-smb devstack@n-api.service[121098]: action_args: {'id': 'cc75295d-59e9-40c9-bdc5-b716be88308b'} Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: {{(pid=121098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 01:22:54.407891 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. Sep 04 01:22:54.409440 dv-cinder-master-3-smb devstack@n-api.service[121098]: ERROR nova.api.openstack.wsgi Sep 04 01:22:54.410999 dv-cinder-master-3-smb devstack@n-api.service[121098]: DEBUG nova.api.openstack.wsgi [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] Returning 404 to user: Instance cc75295d-59e9-40c9-bdc5-b716be88308b could not be found. {{(pid=121098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 01:22:54.410999 dv-cinder-master-3-smb devstack@n-api.service[121098]: INFO nova.api.openstack.requestlog [None req-7b564a7d-8c76-4a20-82d0-631524a24255 tempest-AttachVolumeTestJSON-1533856579 tempest-AttachVolumeTestJSON-1533856579-project] 10.222.0.27 "GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b" status: 404 len: 111 microversion: 2.1 time: 0.030582 Sep 04 01:22:54.410999 dv-cinder-master-3-smb devstack@n-api.service[121098]: [pid: 121098|app: 0|req: 540/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Sun Sep 4 01:22:54 2022] GET /compute/v2.1/servers/cc75295d-59e9-40c9-bdc5-b716be88308b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)